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update  on  Statistics  for  Americans  of 
Spanish  Origin  or  Descent 
By  Jeanne  E.  Griffith 

Office  of  Federal  Statistical  Policy  and  Standards, 

U.S.  Department  of  Commerce 


Progress  in  the  implementation  of  Public  Law  94- 
311,  relating  to  the  collection,  analysis,  and  publica¬ 
tion  of  economic  and  social  statistics  on  Americans  of 
S|)anish  origin  or  descent,  was  last  reported  on  in  the 
February,  1978  issue  of  Statistical  Reporter.  The  law, 
which  was  passed  on  June  16.  1976,  stated: 

“Whereas  more  than  twelve  million  Americans 
identify  themselves  as  being  of  Spanish-speaking 
background  and  trace  their  origin  or  descent  from 
Mexico,  Puerto  Rico,  Cuba.  Central  or  South 
America,  and  other  Spanish-speaking  countries; 
and 

“Whereas  those  Americans  of  Spanish  origin  or 
descent  have  made  significant  contributions  to 
enrich  American  society  and  have  served  their  Na¬ 
tion  well  in  time  of  war  and  peace;  and 

“Whereas  a  large  number  of  Americans  of 
Spanish  origin  or  descent  suffer  from  racial,  social, 
economic,  and  political  discrimination  and  are 
denied  the  basic  opportunities  they  deserve  as 
American  citizens  and  which  would  enable  them  to 
begin  to  lift  themselves  out  of  the  poverty  they  now 
endure;  and 

“Whereas  improved  evaluation  of  the  economic 
and  social  status  of  Americans  of  Spanish  origin  or 
descent  will  assist  State  and  Federal  Governments 
and  private  organizations  in  the  accurate  deter¬ 
mination  of  the  urgent  and  special  needs  of 
Americans  of  Spanish  origin  or  descent;  and 

“Whereas  the  provision  and  commitment  of 
State.  Federal,  and  private  resources  can  only  occur 
when  there  is  an  accurate  and  precise  assessment  of 
need;  Now.  therefore,  be  it 
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“Resolved  by  the  Senate  and  the  House  of 
Representatives  of  the  United  States  of  America  in 
Congress  assembled,  that  the  Department  of  Labor, 
in  cooperation  with  the  Department  of  Commerce, 
shall  develop  methods  for  improving  and  expanding 
the  collection,  analysis,  and  publication  of  unem¬ 
ployment  data  relating  to  Americans  of  Spanish 
origin  or  descent. 

“Sec.  2.  The  Department  of  Commerce,  the 
Department  of  Labor,  the  Department  of  Health, 
Education,  and  Welfare,  and  the  Department  of 
.Agriculture  shall  each  collect,  and  publish 
regularly,  statistics  which  indicate  the  social, 
health,  and  economic  condition  of  Americans  of 
Spanish  origin  or  descent. 

“Sec.  3.  The  Director  of  the  Office  of  Manage¬ 
ment  and  Budget,  in  cooperation  with  the  Secretary 
of  Commerce  and  with  the  heads  of  other  data- 
gathering  Federal  agencies,  shall  develop  a 
CJovernment-wide  program  for  the  collection, 
analysis,  and  publication  of  data  with  respect  to 
.Americans  of  Spanish  origin  or  descent. 

“Sec.  4.  The  Department  of  Commerce,  in 
cooperation  with  appropriate  Federal,  State  and 
local  agencies  and  various  population  study  groups 
and  experts  shall  immediately  undertake  a  study  to 
determine  what  steps  would  be  necessary  for 
developing  creditable  estimates  of  undercounts  of 
.Americans  of  Spanish  origin  or  descent  in  future 
censuses. 

“Sec.  5.  The  Secretary  of  Commerce  shall  ensure 
that,  in  the  Bureau  of  the  Census  data  collection  ac¬ 
tivities,  the  needs  and  concerns  of  the  Spanish- 
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origin  population  are  given  full  recognition  through 
the  use  of  Spanish  language  questionnaires, 
bilingual  enumerators,  and  other  such  methods  as 
deemed  appropriate  by  the  Secretary. 

“Sec.  6.  The  Department  of  Commerce  shall  im¬ 
plement  an  affirmative  action  program  within  the 
Bureau  of  the  Census  for  the  employment  of  person¬ 
nel  of  Spanish  origin  or  descent  and  shall  submit  a 
report  to  Congress  within  one  year  of  the  enactment 
of  this  Act  on  the  progress  of  such  program.” 

Since  early  1978,  a  large  number  of  initiatives 
responsive  to  the  law  have  been  taken  by  a  wide 
variety  of  agencies.  Therefore,  in  late  1979,  the  Office 
of  Federal  Statistical  Policy  and  Standards  (OFSPS)' 
requested  that  the  agencies  specifically  mentioned  in 
the  law,  as  well  as  other  agencies  sponsoring  major 
statistical  programs,  update  the  information  included 
in  the  earlier  article  and  provide  information  on  any 
new  activities  responsive  to  the  law.  This  information 
has  been  used  for  the  purpose  of  developing  this 
government-wide  status  report  on  the  implementation 
of  P.L.  94-311.  This  report  highlights  major  agency 
programs  responsive  to  the  law,  but  is  not  inclusive  of 
the  very  large  number  of  programs  which  have  given 
concerted  attention  to  meeting  the  requirements  of  the 
law. 

The  agencies  providing  this  information  included: 
The  Bureau  of  the  Census  and  the  Office  of  the  Chief 
Economist — Department  of  Commerce;  the  Con¬ 
sumer  and  Food  Economic  Institute,  the  Economics, 
Statistics,  and  Cooperatives  Service,  the  Economic 
Research  Service,  and  the  Office  of  the  Assistant 
Secretary  for  Administration — Department  of  Agri¬ 
culture;  the  Department  of  Housing  and  Urban 
Development;  the  Department  of  Justice;  the 
National  Center  for  Education  Statistics — 
Department  of  Education;  the  National  Center  for 
Health  Statistics,  the  Office  of  Family  Assistance,  and 
the  Office  of  the  Assistant  Secretary  for  Planning  and 
Evaluation — Department  of  Health  and  Human  Serv¬ 
ices;  and  the  Bureau  of  Labor  Statistics,  the  Employ¬ 
ment  Standards  Administration  and  the  Office  of  the 
Assistant  Secretary  for  Policy,  Evaluation,  and 
Research — Department  of  Labor. 

Specifically,  these  offices  were  asked  to  provide  a 
description  of  data  currently  being  collected, 
analyzed,  or  published  which  meet  the  requirements 
of  the  law.  The  description  was  to  cover: 

•  Data  elements  which  are  collected,  analyses 
which  are  produced  either  on  a  periodic  or  one¬ 
time  basis,  and  information  which  is  now 
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published  or  planned  to  be  published  in  the  im¬ 
mediate  future. 

•  The  geographic  detail  available  for  the  data 
collection  and  in  the  reports  as  published. 

•  The  periodicity  of  the  data. 

The  agencies  were  asked  to  augment  information 
on  programs  mentioned  in  the  February  1978  report, 
as  appropriate,  to  reflect  new  programs  or  initiatives. 
In  addition,  they  were  asked  to  provide  information 
on: 

•  .\ny  activities  the  agency  is  currently  undertaking 
which  are  responsive  to  P.L.  94-311. 

•  Modifications  to  ongoing  activities  which  the 
agency  is  currently  planning  or  considering  to  be 
responsive  to  the  requirements  of  P.L.  94-311. 

Reports  from  the  agencies  indicate  that  over  the  last 
2  years  substantial  attention  has  been  given  to  im¬ 
proving  both  the  quantity  and  quality  of  information 
meeting  the  requirements  of  P.L.  94-311.  Programs 
and  initiatives,  considerably  enhancing  Federal  sta¬ 
tistical  data  on  the  Hispanic  population,  are 
widespread.  Further  developments  in  the  programs 
previously  reported  are  as  follows: 

•  The  National  Center  for  Health  Statistics  has 
continued  to  expand  its  program  to  include  an 
Hispanic  identifier  on  vital  (birth  and  death) 
records  maintained  by  State  agencies  and,  in 
turn,  provided  to  the  Federal  Government.  This 
program  now  covers  approximately  88  percent  of 
the  Hispanic  population;  inclusion  of  the  iden¬ 
tifier  is  being  strongly  encouraged  in  the  remain¬ 
ing  States.  As  a  result,  the  Bureau  of  the  Census  is 
conducting  experimental  work  in  an  effort  to 
develop  a  methodology  to  produce  intercensal  es¬ 
timates  of  the  Hispanic  population  by  State  after 
the  1980  census. 

•  The  Bureau  of  Labor  Statistics,  in  collaboration 
with  the  Bureau  of  the  Census,  expanded  the 
sample  of  the  Current  Population  Survey  in  1978 
to  improve  estimates  for  the  Hispanic  population. 
National  labor  force  and  unemployment  statis¬ 
tics  are  published  for  major  subgroups  of  the 
Hispanic  population.  Annual  data  are  published 
for  Hispanics  in  States  and  major  metropolitan 

'  The  responsibility  for  statistical  policy  and  coordination  func¬ 
tions  was  transferred  from  the  Office  of  Management  and  Budget  to 
the  .Secretary  of  Commerce  by  Executive  Order  No.  12013,  effective 
October  9,  1977.  The  responsibility  for  developing  a  government¬ 
wide  program  of  statistics  on  Americans  of  Spanish  origin  or  des¬ 
cent  was  among  those  assigned  to  the  Office  of  Federal  Statistical 
Policy  and  Standards  in  the  Department  of  Commerce. 
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areas.  A  number  of  special  reports  have  been 
published  on  Hispanics  in  the  U.S.  labor  force. 
Seasonally  adjusted  labor  force  measures  for 
Hispanics  will  be  developed  as  soon  as  feasible.  In 
addition,  in  the  redesign  of  the  Current  Popula¬ 
tion  Survey  sample  to  follow  the  1980  Census  of 
Population  and  Housing,  methodologies  to  sub¬ 
stantially  reduce  the  sampling  error  for  the 
Hispanic  labor  force  series  will  be  incorporated. 
In  selected  months,  supplementary  questions  pro¬ 
vide  detailed  statistics  on  other  characteristics  of 
the  Hispanic  population,  including  household 
economic  characteristics,  fertility  characteristics, 
education  data,  and  voting  characteristics. 

•  The  Department  of  Housing  and  Urban  Develop¬ 
ment,  in  collaboration  with  the  Bureau  of  the 
Census,  provides  a  wide  variety  of  statistics  on  the 
housing  and  demographic  characteristics  of  the 
population  through  the  Annual  Housing  Survey. 
National  characteristics  on  occupancy,  utiliza¬ 
tion,  structure,  equipment  and  fuels,  financing, 
and  neighborhood  quality  are  published  an¬ 
nually.  Data  for  selected  SMSA’s  are  published 
on  a  4-year  schedule.  In  addition  to  the  inclusion 
of  data  in  the  regular  publication  series,  a  special 
report  on  housing  of  the  Hispanic  population  was 
published  late  in  1978. 

•  Detailed  health  and  demographic  characteristics 
are  being  obtained  in  the  Health  and  Nutrition 
Examination  Survey  (HANES  II)  conducted  by 
the  Bureau  of  the  Census  for  the  National  Center 
for  Health  Statistics  (NCHS).  Physical  examina¬ 
tions  and  other  measurements  are  administered 
by  the  U.S.  Public  Health  Service.  NCHS  is 
currently  planning  a  supplemental  survey  of 
approximately  12,000  Hispanics  to  produce  data 
on  the  Nation’s  Hispanic  population.  The  data 
will  cover  detailed  health  and  nutritional 
characteristics. 

•  Data  on  the  Hispanic  population  to  be  available 
from  the  1980  Census  of  Population  and  Housing 
will  be  greatly  expanded  over  that  of  the  1970 
Census.  Counts  of  the  Spanish  origin  population 
will  be  available  in  early  1981.  Detailed 
demographic,  social,  economic,  and  housing 
characteristics  of  the  Hispanic  population  will  be 
published.  Also,  to  help  meet  additional  data 
needs,  an  extensive  amount  of  data  in  greater 
geographic  and  subject  detail  will  be  available  in 
unpublished  form  on  computer  tape  or  in  special 
tabulations. 
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Since  the  previous  status  report  on  the  implementa¬ 
tion  of  P.L.  94-311  was  published,  a  wide  variety  of 
developments  in  other  programs  have  also  been 
responsive  to  the  requirements  of  the  law.  .Some  of 
these  are  highlighted  below: 

•  The  Continuous  Longitudinal  Manpower  .Study 
is  conducted  by  the  Bureau  of  the  Census  for  the 
Employment  and  Training  .Administration  of  the 
Department  of  Labor.  The  survey  provides  data 
for  evaluation  of  the  programs  administered  by 
the  Comprehensive  Employment  and  Training 
.Act  (CET.A).  Detailed  data  on  labor  force 
behavior,  education,  job  training,  and  CET.A  ex¬ 
perience  are  published  for  the  Hispanic 
population. 

•  I'he  Survey  of  .Minority-Owned  Businesses  is 
conducted  every  5  years  as  part  of  the  Bureau  of 
the  Census’  series  of  economic  censuses.  Data 
from  the  1977  survey  are  currently  being 
published,  with  detailed  data  on  firms  owned  by 
persons  of  Hispanic  origin.  Estimates  are 
published  for  the  LIS.  and  by  industr\-  division 
for  .States,  S.MSA’s,  counties,  and  cities. 

•  The  .National  Crime  Survey,  conducted  by  the 
Bureau  of  the  Census  for  the  Law  Enforcement 
.Assistance  .Administration  of  the  Department  of 
Justice,  collects  detailed  data  on  crime  victimiza¬ 
tion.  Regular  reports  include  data  on  the 
Hispanic  population,  and  a  special  report  on  vic¬ 
timization  of  Hispanics  compared  to  non- 
Hispanics  is  in  preparation. 

•  The  Uniform  Crime  Reporting  Program  pro¬ 
duces  statistics  on  the  demographic  charac¬ 
teristics  of  victims  and  offenders  as  well  as  on 
characteristics  of  crime  and  arrest  trends.  Data 
on  Hispanic  origin  was  first  collected  in  Januar\- 
1980.  Information  on  Hispanics  will  be  included 
in  the  Federal  Bureau  of  Investigation's  annual 
reports,  beginning  in  1981. 

•  The  Department  of  Agriculture's  Economics,  Sta¬ 
tistics,  and  Cooperatives  Services  (ESCS)  spon¬ 
sors  a  biennial  supplement  to  the  Current  Pop¬ 
ulation  Survey,  the  Hired  Farm  Working  Force 
Survey.  Demographic  characteristics  of  Hispanic 
hired  farm  workers  and  details  of  their  labor  force 
participation  are  collected  at  the  national  and 
regional  levels.  ESCS  is  planning  similar  indepen¬ 
dent  surveys  for  1981  and  1985  which  will  pro¬ 
vide  greater  content  detail  for  smaller  geographic 
areas. 
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•  In  1979,  the  Department  of  Agriculture  conduct¬ 
ed  the  Nutritional  Information  Survey  to  obtain 
detailed  information  on  households’  knowledge  of 
the  nutritional  characteristics  of  their  diets. 
Reports  to  be  issued  beginning  in  1980  will  pro¬ 
vide  information  on  the  Hispanic  population. 

•  In  1979,  the  National  Center  for  Education  Sta¬ 
tistics  field  tested  a  National  Longitudinal  Study, 
High  School  and  Beyond.  Among  other  topics, 
the  survey  will  deal  with  problems  of  Hispanic 
students  and  the  administration  of  bilingual  pro¬ 
grams.  Data  will  be  used  for  both  planning  and 
policy  development.  Data  from  the  actual  survey 
will  be  available  by  region  on  tape  and  in  tabular 
summaries  and  analyses. 

•  The  Social  Security  Administration  is  revising  its 
application  forms  for  social  security  numbers. 
The  new  forms  will  include  a  designation  for 
Hispanic  origin;  they  are  scheduled  to  be  used 
beginning  in  late  1980.  This  is  a  highly  important 
development  which  will  eventually  allow  studies 
based  on  Social  Security  files  to  examine  the 
Hispanic  population  separately.  Data  on  new  ap¬ 
plicants,  including  immigrants  and  young  per¬ 
sons,  will  be  available  shortly  after  the  revised 
forms  are  adopted.  Studies  on  socioeconomic 
characteristics,  earnings,  and  employment 
histories  of  workers  and  beneficiaries,  as  well  as 
matches  to  other  files  for  statistical  purposes,  will 
not  be  able  to  reflect  Hispanic  origin  until  the 
system  matures. 

•  The  Social  Security  Administration  has 
published  a  variety  of  data  on  beneficiaries  from 
the  Old  .\ge.  Survivor,  and  Disability  Insurance 
file  and  the  Supplemental  Security  Income  file  on 
persons  with  Hispanic  surnames  in  five  .South¬ 
western  States  (Arizona,  California,  Colorado, 
New  .Mexico,  and  Texas).  After  the  1980  Census 
of  Population  and  Housing,  lists  of  Hispanic  sur¬ 
names  will  be  improved  and  expanded  to  include 
persons  from  Florida,  Illinois,  New  Jersey  and 
.New  York.  .Special  publications  on  beneficiaries 
have  been  issued. 

•  The  .National  Health  Interview  Survey,  sponsored 
by  the  Public  Health  Service,  provides  detailed 
information  on  the  health  status,  utilization  of 
health  care  facilities,  and  other  health  related 
topics  for  the  Nation’s  population.  The  survey  is 
conducted  on  a  continuous  basis,  and  data  are 
produced  for  the  Hispanic  population.  A  special 
report  on  health  characteristics  of  minority 


groups,  published  in  1978,  includes  information 
on  Hispanics. 

•  The  Department  of  Health  and  Human  Services 
has  initiated  a  Task  Force  on  the  Development  of 
a  Plan  for  Improving  Hispanic  Data  Collection 
and  Analysis  Efforts,  under  the  auspices  of  the 
.Assistant  Secretary  for  Planning  and  Evaluation. 
.At  this  writing,  the  Task  Force  has  not  prepared  a 
final  report,  but  is  in  the  process  of  evaluating 
what  data  and  analyses  are  currently  available.  It 
will  then  identify  data  needed  for  improving  pro¬ 
gram  planning  and  evaluation.  The  Task  Force 
will  develop  final  recommendations  for  internal 
improvements  and  also  for  better  inter¬ 
departmental  coordination  of  Hispanic  data 
collection  efforts. 

These  highlighted  activities  serve  as  examples  to 
represent  a  much  broader  variety  of  programs  being 
conducted  by  the  Federal  Departments  and  agencies 
which  are  responsive  to  the  requirements  of  P.L.  94- 
.^11.  .\dditional  activities  are  either  in  operation  or  be¬ 
ing  planned.  Reports  provided  by  the  various  agencies 
to  the  Office  of  Federal  Statistical  Policy  and  Stand¬ 
ards  are  available  for  review. 

In  addition,  several  Federal  initiatives  affecting  the 
collection  of  race  and  ethnic  information  will  have  a 
continuing  effect  on  expanding  the  variety  of  informa¬ 
tion  available  on  the  Hispanic  population.  Statistical 
Policy  Directive  No.  15,  issued  by  OFSPS  in  October 
of  1977,-  had  a  compliance  deadline  of  January  1, 
1980  for  all  Federal  programs  collecting  race  and 
ethnic  data.  The  directive  provided  standard 
categories  and  definitions,  including  a  separate 
designation  for  persons  of  Hispanic  origin.  A  very 
limited  number  of  waivers  for  the  compliance  deadline 
were  granted  when  agencies  had  developed  specific 
implementation  schedules  with  fixed  target  dates  for 
given  programs,  but  most  programs  were  in  com¬ 
pliance  by  the  start  of  1980. 

In  December  1979,  the  Office  of  Management  and 
Budget  issued  “Interim  Guidelines  for  the  Collection 
of  Race,  Ethnic  Background,  Age,  and  Sex  Informa¬ 
tion  on  .Applications  .Made  by  Individuals  for  Benefits 
from  Federal  Programs.”’  These  guidelines  allow  in¬ 
formation  on  race,  ethnic  background,  age,  and  sex  to 
be  obtained  from  applicants  when  such  information  is 
needed  to  determine  eligibility  or  amount  of  benefit 

-  The  requirement  contained  in  this  directive  was  originally 
issued  in  .\tay  1977  by  0.\IB  in  Circular  No.  A-46,  Exhibit  F. 

'  Published  in  the  /■nli'rril  vol.  44.  No.  2.'?8,  December  10. 

1979, 
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for  a  program  and  also  when  it  is  needed  to  determine 
whether  a  program  is  being  administered  to  provide 
equal  opportunity  to  all  eligible  groups  in  the  popula¬ 
tion.  Prior  to  the  issuance  of  these  guidelines,  agencies 
were  not  permitted  to  obtain  information  on  these 
characteristics  if  the  sole  purpose  was  to  monitor  the 
administration  of  the  program.  This  change  will 
enable  program  agencies  to  monitor  their  progress  in 
fulfilling  their  obligations  under  civil  rights  pro¬ 
visions  such  as  Titles  VI  and  VII  of  the  Civil  Rights 
■Act  of  1964,  as  amended  and  Title  IX  of  the  Educa¬ 
tion  .Amendments  of  1972,  as  amended.  The  data  ob¬ 
tained  will  have  to  meet  the  requirements  of  Directive 
1  .S  issued  by  OFSPS.  Thus,  this  represents  an  impor¬ 
tant  change  in  data  available  on  the  Hispanic  popula¬ 
tion  for  program  policy  analysis.  These  guidelines  will 
be  made  final  in  the  near  future. 

In  February  1980,  the  Department  of  Justice  issued 
a  directive  to  all  Federal  agencies,  “Collection  of 
Race,  Ethnic,  .Age,  and  Sex  Information  on  Appli¬ 


cants  for  Benefits  Under  Federally  Assisted  Pro¬ 
grams.”^  This  directive  instructed  all  agencies  to 
“establish  and  implement  procedures  whereby  the 
race  and  ethnic  background  can  be  determined  of  per¬ 
sons  applying  for  a  service  or  benefit  ...  .”  These 
procedures  are  to  comply  with  all  OMB  policies  on 
data  collection.  This  directive,  then,  strengthens  the 
OMB  guidelines  discussed  above. 

The  Office  of  Federal  Statistical  Policy  and  Stand¬ 
ards  will  continue  to  monitor  agency  progress  in 
meeting  the  requirements  of  P.L.  94-311  through  its 
general  planning  and  coordination  activities,  as  well 
as  in  its  review  of  proposed  statistical  surveys  spon¬ 
sored  by  the  various  Federal  agencies.  New  or  up¬ 
dated  information  concerning  agency  initiatives  to 
collect  and  publish  data  on  Americans  of  Spanish 
origin  or  descent  should  be  provided  to  the  Office  of 
Federal  Statistical  Policy  and  Standards. 

'  Published  in  the  Federal  Register,  vol.  4.S.  No.  29.  Februarv'  II. 
1980. 
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Panel ; 

George  e.  Hall,  U.S.  Bureau  of  the  Census,  Moderator 
F.  THOMASJUSTER,  University  of  Michigan 
Roberta.  Israel,  National  Center  for  Health  Statistics 
Thomas  G.  Staples,  Social  Security  Administration 
Morris H.  Hansen,  Westat  inc. 


George  Hall: 

The  question  of  contracting  for  Federal  surveys  has 
been  an  issue  that  we  have  dealt  with  at  previous  ASA 
meetings;  we  had  a  very  good  session  in  Chicago  a 
couple  of  years  ago.  We  felt  that  it  was  time  to  try  to 
bring  the  issue  to  a  somewhat  better  focus.  So  instead 
of  having  a  session  in  which  a  number  of  papers  would 
be  presented  with  some  limited  time  for  questions 
from  the  audience,  we  decided  it  would  be  ap¬ 
propriate  to  have  a  limited  number  of  people  with 
varying  kinds  of  experiences  in  contracting  for  Federal 
surveys  in  a  panel  and  have  a  very  active,  interactive 
discussion.  The  members  of  the  panel  include  people 
from  the  Federal  sector  who  are  involved  in  con¬ 
tracting  for  Federal  surveys  but  also  who  are  experts 
in  the  statistical  data  collection  activity,  as  well  as 
people  who  come  from  both  the  private  sector  and  the 
world  of  academe.  Each  participant  will  take  a  short 
time  to  develop  an  agenda  for  discussion.  The  presen¬ 
tations  in  no  sense  should  be  considered  papers,  but 
just  a  list  of  the  issues  that  need  to  be  discussed  so 
that,  in  fact,  we  can  have  a  focused  discussion. 

Tom  Juster: 

I  would  like  to  lay  out  some  general  issues  involved 
with  not  simply  contracting  for  Federal  surveys, 
which  is  the  title  of  the  topic  which  overlays  with  my 
renaming  of  it,  which  is  Federal  Support  Mechanisms 
for  Collecting  Social  Science  Data;  this  almost  says 
the  same  thing  but  not  quite.  The  reason  I  want  to 
rename  it  slightly  is  to  get  at  the  notion  that  the  way 
the  Federal  Government  underwrites  social  science 
data  collection  takes  a  variety  of  forms  which  I  think 
ought  to  be  discussed  here  in  terms  of  the  purposes  for 
which  they  are  appropriate.  The  three  forms  which 
need  discussion  are:  request  for  proposals  ( RFP's)  which 
are  out  for  competitive  bid;  sole  source  contracts  in 
which  the  contract  is  not  out  for  competitive  bid;  and 
straightforward  grants  which  obviously  are  not  com¬ 
petitive.  If  you  ask  how  those  differ  in  a  simple- 
minded  way — they  differ  because  in  the  first  two 
cases,  RFP’s  and  sole  source  contracts,  the  research 
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agenda  is  set  by  a  mission  agency  rather  than  by  the 
individual  doing  the  research  for  the  study  or 
collecting  the  data.  In  the  case  of  RFP’s  obviously, 
there  is  also  a  difference  which  I  will  refer  to  in  a 
minute  with  a  few  other  comments  between  that  and 
sole  source  having  to  do  with  the  specificity  of  the 
product.  In  the  case  of  grants  the  big  difference  be¬ 
tween  that  and  the  sole  source  contract  is  that,  for  sole 
source  contract,  in  principle  the  agenda  is  set  by  the 
agencies  letting  out  the  contract.  Their  questions  are 
to  be  answered,  not  the  researchers’  questions.  In  the 
case  of  grants,  the  researchers’  questions  are  to  be 
answered  and  the  agency  says  “Yes  that  is  an  in¬ 
teresting  question;  we  will  underwrite  the  cost  of 
answering  it.” 

The  idea  underlying  the  present  Federal  research 
and  development  (R&D)  policies  appears  to  be  that 
basic  research  is  underwritten  primarily  by  the 
National  Science  Foundation  (NSF).  It  is  dispensed 
on  the  basis  of  unsolicited  grants  after  a  peer  review 
process.  In  contrast  to  how  NSF  operates,  statistical 
mission  agency  procedure  for  obtaining  a  research 
product  often  uses  a  contract  to  do  survey  research  or 
to  gather  data  through  an  RFP.  The  spirit  underlying 
the  movement  toward  RFP’s  is  that  when  it  comes  to 
research  applications  of  particular  relevance  to  the 
policy  problems  facing  mission  agencies,  the  problem 
can  be  sufficiently  well  specified  so  that  it  is 
reasonable  to  solicit  external  bids  on  the  basis  of  a 
well-defined  set  of  criteria  and  procedures.  Given  the 
specificity  of  the  questions,  the  idea  is  that  a  set  of  suf¬ 
ficiently  high  quality  proposals  (over  the  minimum, 
whatever  that  may  be)  can  be  identified  on  the  basis  of 
submissions,  and  that  a  decision  among  the  set  of  ac¬ 
ceptable  proposals  can  then  be  made  on  the  basis  of 
cost  considerations,  gradations  in  quality  among  ac¬ 
ceptable  proposals,  and  impressions  of  the  reviewers 
about  which  submission  is  likely  to  result  in  a  better 
finished  product.  Thus  competitive  forces,  working 

*  Held  at  the  annua)  ineetings  of  the  American  Statistical  Association  (ASA). 
Washinifton,  D.G.,  .\ugust  1979. 
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through  some  combination  of  track  record,  quality 
judgment  and  cost,  will  provide  the  government  with 
the  biggest  bang  for  the  buck,  as  it  were,  and  will  do 
so  in  an  environment  where  the  mission  agency, 
rather  than  the  researchers,  sets  the  research  agenda 
for  its  own  policy  needs. 

All  that  sounds  generally  very  sensible.  The 
procedure  is  clearly  modeled  after  hardware  procure¬ 
ment,  where  development  of  a  piece  of  hardware  is  sub¬ 
ject  to  a  different  set  of  criteria  and  procedures  than 
the  process  of  getting  production  bids  for  application  of  the 
hardware  development,  and  where  basic  and  under¬ 
pinning  development  is  subject  to  still  different 
criteria.  In  the  hardware  area,  or  so  it  seems  to  those 
of  us  who  are  software  and  not  hardware,  it  should 
make  little  difference  whether  the  producers  of  the 
hardware  do  or  don’t  have  close  contacts  with  the 
developers  of  the  ideas  underlying  hardware,  that  cost 
criteria  ought  to  be  very  important,  that  “old  line” 
firms,  that  have  been  in  the  hardware  producing 
business  for  a  long  time  ought  not  to  have  an  advan¬ 
tage  over  new  entrants,  and  thus  that  submitting  open 
bids  on  the  basis  of  rigid  product  specifications  should 
lead  to  a  least  cost/maximum  quality  solution. 

However  there  are  a  couple  of  aspects  of  RFP’s  that 
are  worth  noting;  They  clearly  apply  in  my  experience 
to  responding  to  RFP’s  in  the  social  sciences,  and  may 
apply  to  RFP’s  generally.  One  is  that  a  basic  assump¬ 
tion  underlying  RFP’s  is  that  there  is  little  or  no  com¬ 
plementarity  in  various  parts  of  the  production 
process.  Using  the  hardware  model,  it  makes  no  dif¬ 
ference  to  the  assemblers  of  the  aircraft  who  makes  the 
engine,  who  makes  the  wheels,  who  puts  the  rivets  in 
the  fuselage,  or  who  designs  the  interior  seats.  Given 
the  set  of  specifications  as  to  what  is  required,  all  the 
parts  must  fit,  and  it  makes  no  difference  whether  all 
the  parts  are  made  by  the  same  manufacturer  or  all 
are  made  by  different  ones.  Let  us  call  that  the 
assumption  which  underlies  competitive  RFP's,  that 
there  is  complete  interchangeabiltiy  or  substitut¬ 
ability  among  component  parts  of  a  product  and  there 
is  zero  complementarity  in  production. 

Second,  it  is  always  assumed  that  both  the  original 
specifications  for  the  product,  as  well  as  the  estimates 
of  the  cost  involved  in  obtaining  a  product  with  those 
specifications,  are  well-predicted  and  unchanged  from 
the  time  the  RFP  is  designed  until  the  work  is 
finished.  That  is,  the  assumption  underlying  com¬ 
petitive  bids  via  RFP’s  is  that  the  contractor  knows 
exactly  what  is  wanted,  that  each  of  the  bidders  knows 
what  is  required  in  order  to  meet  the  specifications, 
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that  there  will  be  no  renegotiation  of  the  contract  on 
the  basis  of  unforeseen  circumstances,  and  that  any 
cost  overruns  will  be  absorbed  by  the  contractor  and 
not  by  the  government. 

To  apply  that  model  to  different  types  of  R&D 
procurement,  it  is  clear  that  where  the  outcome  is  un¬ 
certain  or  an  agency  has  a  question  and  is  not  quite 
sure  how  to  answer  it,  the  right  way  to  go  is  the  sole 
source  contract;  where  the  agency  needs  to  produce  a 
certain  R&D  product  but  does  not  have  the  ex¬ 
perience  to  know  exactly  what  ought  to  be  done,  then 
the  agency  ought  to  go  with  sole  source — agree  with 
the  contractor  on  the  nature  of  the  problem  to  be 
solved,  and  then  work  jointly  on  the  basis  of  what 
costs  are  allowable,  what  the  design  steps  are,  what 
the  next  step  is,  and  so  forth.  If  that  is  not  the 
problem,  if  it  is  a  straightforward  production 
problem,  then  a  competitive  RFP  is  fine;  if  you  are  do¬ 
ing  the  basic  research,  you  do  not  want  to  do  either 
and  you  want  to  use  grants. 

That  is  theory.  It  is  useful  to  compare  this  theoretical 
world  with  the  actual  world  of  social  science  R&D,  in 
particular  in  contracting  work  for  social  science  data 
collection  and  Federal  surveys.  Everybody  here  has 
some  familiarity  with  RFP’s  sole  source  contracts, 
and  grants;  everyone  knows  that  the  alleged  dif¬ 
ferences  sometimes  do  not  exist.  Some  RFP’s  are 
really  sole  source  contracts — we  refer  to  them  as  wired 
RFP’s;  some  sole  source  contracts  are  just  like  grants 
but  the  agency  cannot  make  grants,  because  they  are 
not  allowed  to,  so  they  call  it  sole  source  contracts;  I 
think  everybody  knows  that  the  parts  are  not  really  in¬ 
terchangeable  and  I  doubt  that  anyone  believes  that 
cost  overruns  are  always  borne  by  the  contractor 
when  it  comes  to  actually  carrying  out  the  research 
contracts  issued  under  RFP’s. 

That  is  a  general  theoretical  structure  which  to  me 
makes  sense.  I  have  some  comments  about  specific  il¬ 
lustrations  of  how  the  world  to  me  is  very  different 
than  the  world  that  alleges  to  underpin  competitive 
bidding.  But,  in  the  absence  of  time,  let  me  instead 
simply  specify  what  from  my  perspective  as  the  direc¬ 
tor  of  a  research  institute  in  a  university  constitutes 
some  of  the  characteristics  of  RFP’s  which  make  them 
clearly  an  undesireable  way  to  achieve  optimum 
research  allocation  when  it  comes  to  how  to  spend 
R&D  money  in  the  social  sciences  in  general. 

Number  one:  RFP’s  are  not  by  design  but  in  fact, 
anti-university.  The  reason  is  very  simple:  typical 
deadline  is  four  weeks.  The  university  professors  are 
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not  around  in  August;  if  an  RFP  comes  out  in  August, 
none  of  us  will  ever  see  it  unless  we  happen  to  get  a 
call  from  someone  who  says  look  at  what  we  have. 
People  simply  do  not  make  commitments  a  month  in 
advance,  when  they  have  teaching  commitments 
made  four  months  in  advance.  The  timing  is 
impossible. 

Number  two:  The  average  hit  rate  for  all  RFP’s  in 
the  only  study  that  I  have  seen  says  that  you  win  on  1 
out  of  5;  that  means  you  make  four  unsuccessful  bids 
to  get  one.  That  is  the  average — some  firms  do  a  lot 
better,  some  do  worse.  From  the  university  scholar’s 
point  of  view,  he  or  she  cannot  afford  to  have  a  hit  rate 
of  20%,  because  while  they  might  get  a  published 
product  out  of  the  one  they  hit  on,  because  they  do  the 
work  and  publish  it  as  an  article;  the  ones  they  do  not 
hit  on  they  invest  time  in,  cost-time,  and  have  almost 
no  return.  The  RFP  is  sufficiently  circumscribed  so 
that  you  do  not  get  a  journal  article  out  of  an  RFP 
response  that  does  not  win.  You  might  have  one  that 
does  win;  so  you  have  to  soak  up  four  times  the  cost  to 
win  one.  University  scholars  cannot  do  that. 

Number  three:  University  scholars  like  to  think  of 
themselves,  with  perhaps  a  grandiose  notion  of  their 
exalted  status,  as  people  who  originate  research  ideas, 
not  who  respond  to  other  people’s  research  ideas. 
That  is  Just  a  general  characteristic  which  makes  uni¬ 
versity  people  less  responsive,  in  general,  to  RFP’s 
because  people  take  the  view  they  do  not  want  to  re¬ 
spond  to  your  questions,  they  want  to  ask  their  ques¬ 
tions.  That  is  their  problem  and  there  is  not  much  one 
can  do  about  that. 

Let  me  note  two  further  characteristics  of  RFP's 
which  are  undesirable  characteristics  from  the  point 
of  view  not  of  universities,  but  Just  of  social  science 
development  in  order  to  give  the  biggest  gain  for  the 
buck. 

First,  let  me  focus  a  bit  on  the  hit  rate  issue,  that  is 
the  one  class  of  success  that  was  averaged  in  the  only 
study  I  have  seen,  across  all  RFP’s.  Economists  would 
say  that  firms  specialize  in  whatever  it  is  that  max¬ 
imizes  the  profit;  that  is,  if  it  is  desirable  to  produce 
high  quality  research  to  maximize  profits,  that  is  how 
you  acquire  staff.  In  the  RFP  business  that  is  not  true. 
What  will  happen  is  any  competent  and  well-run  RFP 
firm  will  have  a  very  good  collection  of  people  whose 
Job  is  to  answer  RFP’s.  Those  sample  people  may  be 
less  well  adapted  to  do  a  high  quality  research.  There 
is  not  perfect  substitutability  between  answering 
RFP’s  in  an  effective  way  and  responding  to  agencies’ 
needs  and  doing  the  work.  Given  the  1  in  5  hit  rate,  if  I 
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were  an  RFP  firm,  I  would  make  sure  1  had  very  high 
quality  people  writing  RFP  responses.  I  would  worry 
less  about  whether  I  could  do  it  once  I  got  it  and  it 
seems  to  me  specialization  theory  would  tell  me  that 
RFP  firms  tend  to  be  very  good  at  hit  rate  manipula¬ 
tion  and,  on  the  average,  they  would  be  less  good  at 
actually  carrying  out  the  work  which  they  have  con¬ 
tracted  to  do. 

Second,  the  cost  overrun  issue  is  one  that  we  ought 
to  get  into  because  many  of  my  colleagues  out  at  the 
Institute  for  Social  Research  are  persuaded,  rightly  or 
wrongly,  that  one  of  the  problems  that  many 
organizations  have  is  that  they  bid  what  they  think  are 
actual  costs,  they  get  outbid  by  virtue  of  people  who 
underbid  actual  costs  and  then  because  the  product 
specifications  are  vague  enough  to  allow  renegotiation 
they  never  get  hung  with  the  actual  higher  costs.  The 
standard  mechanism  that  our  people  see  as  happening 
is  an  RFP  comes  out,  people  look  at  it  and  say  “Well, 
there  is  enough  fuzziness  in  here  so  we  can  put 
together  a  bid  which  we  could  Justify;  and  when  it 
comes  to  the  agency  actually  working  with  us,  if  we 
win  it,  they  will  come  to  us  and  say  that  it  is  not  quite 
what  we  wanted,  let  us  renegotiate;  then  when  the 
renegotiation  comes  along,  if  we  underbid  by  50%  that 
is  your  chance  to  make  it  up — and  that  is  exactly  what 
is  going  to  happen.’’  Therefore,  the  lack  of  specificity 
which  underpins  RFP’s  essentially  means  that  cost 
overruns  are  not  borne  by  the  contractor,  they  are  in¬ 
stead  borne  by  the  government,  and  any  well-run 
RFP  firm,  or  a  firm  that  does  a  lot  of  that,  is  going  to 
be  able  to  make  up  the  underbid  if  there  is  some 
renegotiation.  Renegotiation,  the  way  these  things  are 
done,  is  inevitable.  This  all  seems  to  be  a  highly  un¬ 
desirable  characteristic  of  the  RFP  system  and  I  have 
some  suggestions. 

My  main  suggestion  is  scrap  the  system,  but  no  one 
is  going  to  buy  that.  My  second  set  of  suggestions  is 
modify  it  to  make  it:  (a)  a  little  more  tolerable  for  uni¬ 
versity  people;  and  (b)  closer  to  what  would  be 
produced  in  a  system  designed  to  deal  with  optimum 
research  allocations. 

Boh  Israel: 

My  introductory  remarks  take  off  from  the  assump¬ 
tion  that  we  are  dealing  in  fact  with  a  contract 
mechanism  for  a  Federal  survey  rather  than  address 
the  issues  that  Tom  Juster  has  raised  as  to  whether 
that  mechanism  is  appropriate.  1  have  been  asked  to 
focus  particularly  on  the  RFP.  I  would  like  to  begin  by 
recalling  to  you  some  of  the  principal  steps  that  must 
be  considered  in  the  development  of  a  sample  survey. 
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As  a  matter  of  fact,  according  to  Professor  William 
Cochran,  there  are  9  such  groupings  of  activities:  a 
statement  of  objectives,  a  definition  of  a  population  or 
universe  to  be  sampled,  a  determination  of  the  data  to 
be  collected,  methods  of  measurement,  choice  of  sam¬ 
pling  unit  or  sample  selection,  the  organization  of  field 
work  summarization  of  data,  analysis,  and  a  feedback 
cycle  at  the  end  where  information  gained  from  one 
particular  survey  can  be  used  for  planning  future 
surveys — things  like  levels,  variances,  costs,  and  so  on. 

I  want  to  point  out  that  in  my  experience  the  satisfac¬ 
tion,  or  dissatisfaction,  that  results  from  a  contracted 
Federal  survey  is  to  a  very  large  extent  dependent  on 
the  degree  of  specificity,  as  Tom  mentioned  a  moment 
ago,  that  goes  into  an  RFP.  I  think  that  each  of  these  9 
points  that  Cochran  had  outlined  a  number  of  years 
ago,  must  be  addressed  in  one  way  or  another  in  the 
preparation  of  an  RFP  for  Federal  surveys  to  be 
carried  out  in  the  contract.  That  does  not  mean  to  say 
that  each  and  every  one  of  those  points  must  be  laid 
out  in  the  fullest  detail  by  the  mission  agency,  but  at 
least  some  attention  must  be  given  to  them  at  some 
time  in  the  preparation  of  the  RFP.  1  think  that  the 
quality  of  RFP's  could  be  vastly  improved  for  Federal 
surveys  if  there  were  general  guidelines  established  for 
the  development  of  RFP’ s.  This  is  certainly  not  a  new 
idea,  but  1  would  like  to  pursue  it  for  just  a  few  mo¬ 
ments. 

I  think  general  guidelines,  or  a  checklist  could  be 
looked  upon  in  two  parts.  The  first  part  would  contain 
guidelines  that  are  common  to  all  RFP’s.  I  am  not  go¬ 
ing  to  pay  much  attention  to  that  aspect  because  I 
think  Federal  agency  contract  officers  are  well  aware 
of  these  general  areas  and  they  stand  ready  to  recom¬ 
mend,  if  not  to  insist,  that  certain  points  be  covered, 
including  a  clear  and  detailed  work  statement,  special 
reporting  requirements,  proposal  evaluation  criteria 
and  so  forth.  The  second  part  of  the  guidelines  for 
RFP’s  would  address  those  aspects  that  I  believe  are 
peculiar  to  contracts  for  surveys.  It  is  here  that  par¬ 
ticular  attention  must  be  given  to  the  preparation  of 
the  RFP  and  I  strongly  advocate  a  checklist  of  items  to 
be  included.  The  checklist  should  cover  items  for  con¬ 
sideration  in  the  scope  of  work  statement  itself,  in  the 
list  of  deliverables,  in  the  timeable  requirements,  in 
the  proposal  evaluation  criteria  and  in  the  rating 
guidelines. 

As  part  of  the  scope  there  must  be  particular  atten¬ 
tion  paid  to  many  specifics  beginning  with  the  state¬ 
ment  of  purpose  and  background.  This  can  be  a  very 
brief  paragraph  giving  the  contract  with  some  of  the 
insight  into  the  need  for  and  the  scope  of  the  survey. 
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Regarding  the  development  and  design  of  question¬ 
naires,  it  is  essential  that  the  requirements  be  made 
clear  and  that  the  mission  agency  express  itself  as  to 
whether  they  are  expecting  the  contractor  to  have 
available  both  subject  matter  experts  and  technical 
design  experts  or  only  one  or  the  other.  It  is  also  im¬ 
portant  to  include  sufficient  detail  so  that  a  prospec¬ 
tive  contractor  can  accurately  assess  the  amount  of 
work  that  will  be  involved.  If  there  are  any  foreign 
language  requirements  this  must  also  clearly  be  point¬ 
ed  out.  As  far  as  design  and  selection  of  the  sample 
are  concerned,  if  the  survey  will  include  all  of  the  ele¬ 
ments  in  the  target  group  this  must  be  so  stated.  If  a 
probability  sample  is  desired  this  too  must  be  clearly 
stated  and  the  precision  requirements  must  also  be 
given.  The  levels  of  geographic  and  demographic 
detail  must  be  indicated  including  precision  require¬ 
ments.  There  must  be  given  to  the  contractor  suf¬ 
ficient  information  for  him  to  formulate  an  intelligent 
offer.  .\lso  in  a  checklist,  consideration  must  be  given 
to  the  development  of  manuals  for  supervisor,  for  in¬ 
terviewers,  for  edit  clerks  and  so  on.  Also  attention 
should  be  given  to  the  development  of  training 
programs  for  the  various  sorts  of  personnel  involved  in 
data  colletion  and  data  processing  procedures.  And 
particular  attention  must  be  given  to  aspects  of 
quality  control  such  as  supervision,  observation  of  in¬ 
terviews,  record  checks,  reinterviews,  coverage  checks, 
and  edit  checks. 

The  RFP  should  address  the  conduct  of  test  pro¬ 
cedures  that  are  necessary,  such  as  feasibility  tests, 
pretests,  pilot  tests,  pretests  of  revisions,  and  so  forth. 
The  required  response  rate  and  the  development  of  in¬ 
troductory  letters,  followup  letters,  phone  callback 
procedures  and  other  followup  steps  appropriate  to 
the  survey  should  be  addressed  in  one  form  or 
another. 

Other  items  that  belong  in  this  checklist  would  be 
provision  for  data  processing  including  coding  in¬ 
structions  and  quality  control  measures.  Who  will 
develop  them,  how  will  they  be  developed,  what  stand¬ 
ards  shall  they  meet?  Submission  of  reports;  what 
kinds  of  reports  should  be  forthcoming,  who  has  rights 
in  the  data,  and  so  on.  We  must  not  overlook  a  clear 
indication  of  how  confidential  items  should  be  han¬ 
dled.  What  requirements  are  there  for  protection  of 
confidentiality  and  invasion  of  privacy?  There  could 
also  be  included  in  a  checklist  a  series  of  things  to  be 
considered  in  the  list  of  deliverables;  Versions  of 
questionnaires,  manuals,  training  guides,  editing 
guides,  computer  programs,  and  so  on.  There  should 
be  provision  for  feedback  to  the  originating  agency, 
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recordings  or  transcripts  of  key  training  or  debriefing 
sessions  with  interviewers  and  supervisors.  The  sam¬ 
pling  frame  and  specifications  should  be  included. 

Another  topic  which  must  be  addressed  in  an  RFP 
is  the  timetable.  Is  there  a  deadline  for  the  survey  data 
collection  to  begin?  For  example,  if  data  are  to  be 
gathered  about  a  particular  time  period,  or  before  a 
particular  event,  then  the  dates  of  award  and  the 
beginning  cf  field  work  must  be  set  in  relation  to  that 
time  period  or  event.  Obtaining  clearances  and  allow¬ 
ing  sufficient  time  for  that  process  as  well  as  adequate 
and  realistic  estimates  on  the  part  of  the  government 
agency  for  ihe  mechanical  process  of  awarding  a  con¬ 
tract  must  be  clearly  envisioned  in  advance.  Some 
dates  may  be  fixed;  for  example,  the  time  when  final 
survey  results  are  needed.  From  such  known  dates, 
the  dates  when  other  key  activities  must  begin  and 
end  can  be  determined.  These  dates  must  be  used  in 
preparing  the  requirements  for  deliverables.  Care 
must  be  taken  here  to  allow  sufficient  time  between 
deliverables  which  are  dependent  on  one  another. 

Tom  Staples. 

fom  Juster  has  addressed  some  of  the  appropriate 
mechanisms  that  the  government  uses  to  obtain  con¬ 
tracts.  Bob  Israel  talked  about  the  competitive 
process,  and  laid  out  a  very  reasonable  set  of  require¬ 
ments  if  the  government  is  to  do  sensible  contracting 
in  this  area. 

1  am  going  to  address  some  of  the  concerns 
regarding  how  we  select  among  bids.  I  do  not  think  we 
can  address  this  subject  in  a  uniform  manner — we 
cannot  assu  me  that  for  differing  kinds  of  work  you 
would  want  to  use  the  same  selection  process.  That  is 
my  basic  premise.  Also  for  this  discussion  1  prefer  to 
back  away  from  the  details  of  how  we  select  contrac¬ 
tors  and  to  reexamine  the  basic  issues,  many  of  which 
have  been  discussed  here.  These  issues  themselves 
play  a  large  role  in  dictating  how  we  go  about 
selecting  contractors.  To  recap  some  of  those,  lom 
Juster  mentioned  the  various  stages  in  which  we  may 
come  out  with  requests  for  proposals.  Some  may  be 
developmental  kinds  of  work;  others  may  be  data 
collection.  Some  kinds  of  work  are  clearly  more  ap¬ 
propriate  to  the  competitive  process  than  others.  So  I 
think  we  first  need  to  classify  the  potential  work  in 
some  way.  Then,  the  government  can  sort  the  work 
into  similar  categories.  Second,  something  that  has 
not  come  up  here,  just  as  there  is  considerable 
variability  among  contractors  in  terms  of  the  types  of 
staff  they  employ,  there  is  a  similar  amount  of 
variability  within  the  Federal  sector.  .Some  agencies 
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are  much  better  equipped  to  specify  contracting  re¬ 
quests.  .Similarly  agencies  are  equipped  differently  in 
terms  of  capability  to  evaluate  requests  when  they 
come  in.  Third,  we  have  to  be  able  to  decide,  initially, 
on  something  I  will  call  “maturity  of  the  work  in  that 
area.”  For  example,  even  on  something  that  is 
production  oriented,  say  straight  data  collection,  the 
requirements  are  rather  different  when  talking  about 
data  collection  related  to  migrant  laborers,  compared 
with  data  collection  related  to  social  security 
beneficiaries  where  the  agency  has  list  files  available 
to  the  contractor.  Let  me  take  another  example  in  the 
income  area.  If  we  are  talking  about  designing  and 
implementing  an  income  experimentation  package 
given  the  experience  to  date,  we  are  well  along  in  the 
field  of  knowing  how  to  write  a  request,  how  to 
evaluate  a  request,  etc.  If  on  the  other  hand,  in  these 
same  income  programs,  we  are  looking  at  the  at¬ 
titudes  of  the  general  population  toward  those 
programs,  and  the  attitudes  of  the  beneficiaries  of 
those  programs,  I  do  not  believe  the  science  is  nearly 
as  well  developed.  .So,  giving  the  conclusion  first,  these 
variables  need  to  be  considered  and  the  government  as 
a  whole  needs  to  tailor  its  contracting  efforts  to  its  re¬ 
quirements.  If  we  had  some  reasonable  way  to  sort  the 
g('vernment  work  then  the  selection  process  would  be 
re.atively  straightforward.  So,  the  question,  it  seems 
to  me,  is  how  does  the  government  as  a  w  hole  devise  a 
workable  sorting  process.  In  connection  with  that, 
how  do  we  assure  that  a  given  government  agency, 
which  has  a  particular  need,  also  has  the  capability  to 
request,  evaluate,  and  finally  choose  among  the 
groups  available  to  do  the  work. 

.'\s  an  aside  to  this  point,  I  am  chairing  an  in¬ 
teragency  committee  that  is  focusing  on  addressing 
many  of  these  kinds  of  concerns.  I  hope  as  we  work 
our  way  through  we  will  be  able  to  have  some 
reasonably  firm  suggestions.  In  the  meantime,  I  do 
not  propose  an  answer  to  the  questions  I  have  raised. 
But  I  will  suggest  some  approaches  that  seem 
worthwhile  to  me.  With  rare  exception,  an  up  front 
statement  of  dollars  in  the  contracting  process  would 
be  important.  Obviously  for  the  contractor  to  know 
explicity  what  scale  is  planned  is  important.  But  it  is 
also  important  for  the  government  agencies  them¬ 
selves.  If  dollars  were  not  at  issue,  then  the  agencies 
could  be  spending  more  of  their  energy  evaluating  the 
technical  requirements  of  the  work. 

■Second,  somewhere  at  the  agency  level,  the  major 
department  level,  possibly  at  some  central  govern¬ 
ment  location,  a  review  of  each  proposed  major  piece 
of  work  that  would  determine  the  appropriate  con- 
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tract  or  grant  mechanism  should  be  established.  This 
requires  some  flexibility  on  the  part  of  the  executive 
branch  to  choose  among  the  mechanisms  and  a 
recognition  that  the  open  competitive  procurements 
have  their  limitations.  Specifically,  there  must  be  a 
willingness  and  a  general  commitment  to  carry  out 
grant/contract  work  using  various  mechanisms. 
Currently  this  is  not  always  the  case. 

Third,  as  regards  agency  expertise,  we  need  to 
develop  some  way  to  certify  selected  offices,  agencies, 
contracting  units,  whatever  as  having  sufficient  exper¬ 
tise  to  write  and  evaluate  RFPs.  Perhaps  a  minimal 
suggestion  in  this  respect  is  to  assure  there  is  a 
technical  service  group  that  can  be  turned  to  for  both 
advice  and  assistance  in  the  contracting  area. 

Morns  Hansen: 

I  am  supposed  to  comment  especially  on  issues  of 
funding  the  contracts  and  post-award  activities  to 
monitor  the  contract.  It  seems  as  though  some  of  the 
same  points  get  emphasis  in  the  different  presenta¬ 
tions,  probably  because  they  are  points  that  are  caus¬ 
ing  trouble  in  the  different  aspects.  Certainly  one  issue 
I  want  especially  to  emphasize,  and  one  that  Tom 
Staples  just  made,  in  connection  with  funding,  is  the 
importance  of  indicating  in  the  RFP  the  size  of  the  ef¬ 
fort  expected.  This  is  done  in  different  ways.  Some¬ 
times  the  number  of  questionnaires  is  specified;  it  is 
helpful  to  have  even  that  kind  of  an  indication,  but 
that  is  a  very  unsatisfactory  one.  Man  years  are  often 
used  as  a  device;  people  have  appropriate  formulas  for 
converting  those  to  dollars.  This  is  not  nearly  as  bad 
as  questionnaires  as  a  measure,  but  the  best  measure 
by  far  is  dollars — and  if  bidders  think  the  specified 
dollars  are  too  small  to  do  anything  useful  they  should 
say  so;  if  they  do  not  need  that  much  they  have  the  op¬ 
portunity  to  say  so.  1  think  a  particularly  undesirable 
specification  in  an  RFP  as  a  condition  to  be  met,  as 
distinguished  from  indicating  the  orders  of  magnitude 
wanted,  is  the  variances — the  size  of  variances  you 
want.  If  you  had  a  unique  statistic,  and  that  is  the  one 
purpose  of  the  survey,  and  there  is  a  lot  known  about 
the  survey  topic,  this  is  a  tolerable  way  to  go  about  it. 
Otherwise,  because,  in  advance  of  taking  the  survey, 
variances  can  only  be  speculated,  it  is  a  way  of  com¬ 
municating  very  little  and  making  for  much  more 
Judgment  when  it  comes  to  the  time  of  awarding  the 
contract.  Fotal  dollars  specified  make  it  possible  to 
focus  attention  on  what  the  real  issues  are,  and  who 
has  the  kinds  of  resources  and  ideas  to  deal  with  the 
topic.  Specifying  the  amount  of  dollars  available 
makes  it  possible  to  avoid  what  I  think  are  par¬ 
ticularly  undesirable  aspects  of  competitive  bidding 
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on  surveys.  An  approach  that  has  turned  out  to  be 
definitely  undesirable  in  many  cases  is  where  con¬ 
tracts  have  been  awarded  on  the  basis  of  identifying  a 
few  eligibles  and  then  looking  at  the  dollars  and 
choosing  the  lowest  bidder  among  these.  That  creates 
very  bad  incentives  in  the  whole  system,  and  I  have 
seen  that  done  where  there  is  a  difference  of  $25,000  in 
bids  of  $750,000  order  of  magnitude  for  the  contract. 
That  means  that  bidders  are  going  to  fail  to  include  in 
the  contract  proposal  things  that  ought  to  be  included 
in  the  contract,  such  as  evaluation,  adequate 
reporting,  and  documentation.  Things  like  this  should 
be  done,  but  if  you  include  them  in  the  bid  you  are  at 
a  disadvantage  in  the  bidding  process. 

This  gets  to  the  second  point  1  want  to  emphasize, 
which  is  that  evaluation  and  adequate  documentation 
should  be  included  in  the  funding  and  should  be  ex¬ 
plicitly  provided  for. 

With  respect  to  post-award  activities  to  monitor  a 
contract  I  want  to  strongly  emphasize  the  desirability 
of  close  continuing  interchange  and  joint  participation 
in  the  initial  development  work  and  at  important 
stages  of  planning  and  execution  of  the  work. 

The  actual  working  of  the  RFP  sometimes  specifies 
more  details  than  desirable,  and  emphasizes  the  need 
for  detailed  specifications  in  the  proposal.  I  think  that 
overspecification  in  the  RFP  often  occurs,  and  if  it  is 
overspecified  the  organization  doing  the  work  has  very 
little  latitude  to  do  a  better  job  than  is  specified;  if  the 
initial  specification  is  well  done  there  is  no  problem, 
but  often  it  is  not  and  there  is  a  problem.  It  is 
desirable  to  approach  the  whole  contract  as  though 
that  contract  award  is  the  first  step  in  planning  the 
design.  The  timing  between  the  time  an  RFP  is  an¬ 
nounced  and  the  time  that  the  proposal  is  to  be  in,  as 
l  orn  Juster  indicated,  is  very  short.  He  makes  a  case 
for  lengthening  it.  The  shortness  of  that  timing,  and 
whether  it  should  be  lengthened  or  not,  might  come  in 
for  further  discussion.  But  the  shortness  of  that  timing 
means  that  whoever  proposes  on  this  RFP,  unless  they 
have  been  working  on  this  subject  in  various  specific 
ways  for  some  time  in  advance,  will  not  have  an  op¬ 
portunity  and  could  not  afford  to  put  into  this  work 
the  kind  of  effort  that  must  be  done  in  order  to  do  the 
effective  kind  of  job  that  ought  to  be  done.  You  need  to 
expect  to  revise  and  improve  the  whole  system  after 
the  contract  is  awarded,  through  communication  be¬ 
tween  the  contractor  and  the  sponsor.  That  needed 
communication  and  interaction  are  barred  during 
preparation  by  the  contracting  process.  They  cannot 
be  accomplished  after  the  RFP  is  announced  and 
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before  the  proposal  has  been  submitted.  We  need  to 
have  that  opportunity;  it  should  be  expected  that 
what  is  proposed  in  the  RFP  is  something  you  are 
willing  to  do,  but  there  should  be  a  chance  of  improve¬ 
ment  through  interaction  and  additional  effort  on 
design.  There  ought  to  be  that  opportunity  for  con¬ 
tinuous  joint  development,  in  order  to  maximize  the 
ability  to  identify,  within  the  funds  available,  and 
react  to  the  needs  of  the  agency  that  wants  the 
information. 

Continuing  communication  and  participation  in 
the  developmental  work  are  needed,  especially,  and 
then,  so  tliat  there  will  be  no  surprises  later  on,  con¬ 
tinuing  communication  to  make  sure  that  the  develop¬ 
ment  of  the  survey  operations  is  jointly  communicated 
and  understood.  For  the  sponsor  to  observe  and  par¬ 
ticipate  in  things  like  training  and  the  various  aspects 
of  the  operation  as  it  goes  on  I  regard  as  highly 
desirable. 

In  summary,  I  believe  the  approach  in  contracting 
should  be  to  attempt  to  serve  the  interests  of  the 
government.  This  involves  not  restricting  information, 
or  strait-jacketing  the  process  so  narrowly  that  the 
government’s  interests  cannot  be  effectively  served  as 
a  consequence  of  what  might  be  a  misguided  or  inef¬ 
fective  attempt  to  make  the  award  appear  to  be  an  ob¬ 
jective  process  assuring  equal  treatment  of  potential 
contractors.  I  think  too  often  people  do  treat  this  the 
way  Tom  Juster  said — at  least  contracting  officers 
tend  to — as  though  this  is  a  fixed  product  with  the 
same  content  no  matter  who  is  bidding  on  it,  and  that 
it  is  just  a  matter  of  making  sure  they  don’t  exceed  the 
budget,  and  that  you  get  the  same  product  whoever  is 
awarded  the  contract.  That  is  not  the  way  the  real 
world  is,  and  I  think  that  you  need  to  protect  the 
government’s  interests  by  awarding  within  a  system 
that  makes  it  feasible  to  serve  the  needs  of  the  govern¬ 
ment.  .Again,  equal  treatment  of  contractors  is  a  very 
important  thing  in  the  minds  of  many  people,  and  I 
think  it  is  a  highly  desirable  thing  to  have  equal  treat¬ 
ment  of  contractors.  But  it  does  not  mean  that  you  can 
avoid  judgments.  You  cannot  reduce  it  to  a  system 
that  avoids  them,  and  I  think  you  can  best  face  up  to 
those  judgments  required  if  you  do  not  let  a  few 
dollars’  difference  in  someone’s  bid,  among  eligibles, 
be  the  determining  factor. 

(leorge  Hall: 

I  am  confronted  with  a  bit  of  continuing  frustration 
when  listening  to  the  speakers,  not  frustration  with 
the  speakers,  but  there  is  a  certain  amount  of  frustra¬ 
tion  with  the  process  that  they  have  pointed  out.  Tom 
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Juster  and  Morris  Hansen  have  both  talked  about  the 
interaction  between  the  contractor  and  the  Federal 
agency  and  how  that  relationship  can  be  developed 
toward  an  end  of  developing  a  product.  Both  Tom 
Staples  and  Bob  Israel  have  talked  about  the  kinds  of 
specifications  we  need  and  Bob’s  list  of  issues  was  very 
appropriate  and  Tom’s  concerns  showed  that  we  can 
differentiate  between  development  and  production.  I 
am  left  with  this  kind  of  frustration.  It  seems  to  me 
that  when  we  talk  about  the  problems  with  Federal 
contracts  we  really  are  not  focused  on  the  Bureau  of 
the  Census,  on  the  Bureau  of  Labor  Statistics,  Office 
of  Research  and  Statistics,  and  so  forth.  The  problems 
here  come  from  the  other  kinds  of  agencies,  the 
general-purpose  Federal  agencies,  the  funding  agen¬ 
cies,  and  so  forth  who  need  data  for  some  specific  pur¬ 
pose  or  that  just  need  data  for  planning  purposes. 
How,  then,  can  we  accomplish,  or  how  can  we  get 
across  what  seems  to  be  a  very  wide  gulf.  Cochran’s  9 
steps  that  Bob  outlined  made  me  think  of  some  of  the 
agencies  that  I  have  been  associated  with  and  their 
contract  people  would  not  know  what  he  was  talking 
about.  Unfortunately,  neither  would  the  subject- 
matter  people.  On  the  other  hand,  Tom  Juster  and 
Morris  Hansen  made  a  plea,  and  it  is  one  that  I  am 
very  comfortable  with,  that  the  contractor  should 
really  get  together  with  the  Federal  agency  and 
develop  a  kind  of  process  that  will  provide  the  data 
that  the  Federal  agencies  need.  Morris  even  made  the 
statement  about  treating  contractors  equally — equal 
treatment  of  contractors.  But  where  1  am  frustrated  is 
the  other  side  of  the  coin.  Here  is  a  legitimate  problem 
with  Federal  procurement.  There  is  a  Westat  here  in 
this  area,  there  is  an  ISR  out  in  Ann  .Arbor,  and  I 
could  name  a  dozen  other  reputable,  well-staffed,  ex¬ 
pert  firms,  both  in  the  private  sector  and  in  the  Uni¬ 
versity  sector,  and  I  would  like  to  say  that  there  are 
also  Federal  agencies  which  are  in  the  contracting 
business.  How  do  I  as  a  program  manager  in  a 
Federal  program,  identify  the  fly-by-night  Widget 
Company  as  against  Westat  or  ISR.  It  seems  to  me 
that  is  the  frustration  with  which  I  am  faced.  How  is 
the  Federal  manager  supposed  to  accomplish  that 
very  long  step?  This  seems  to  be  the  nut  of  the  issue 
that  we  really  have  to  address.  I  am  not  sure  of  how 
we  should  advise  the  nonstatistical  agencies  to  behave 
in  this  area. 

Bdh  Israel: 

The  basis  of  much  of  your  frustration,  George, 
stems  from,  as  you  indicated  yourself,  the  Federal 
procurement  process.  I  think  you  have  to  examine 
carefully  what  kinds  of  procurements  are  appropriate 
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under  the  contract  process  and  what  kinds  are  ap¬ 
propriate  under  the  grant  process  and  whether  there 
are  other  processes  either  in  existence  or  that  need  to 
be  developed  in  between  the  grant  process  and  the 
contract  process.  Traditionally,  and  even  legally,  the 
contracting  process  is  geared  to  a  hardware  acquisi¬ 
tion  that  Tom  Juster  talked  about.  Although  I  do  not 
know  that  I  fully  agree  with  him  that  if  you  go  the  con¬ 
tract  route  and  are  approaching  something  in  the 
range  of  acquiring  a  piece  of  hardware  that  it 
necessarily  indicates  the  changeability  of  parts;  I 
think  this  might  be  debated.  Nevertheless,  the  con¬ 
tract  mechanism  says — here  is  a  government  agency 
and  it  knows  what  it  wants;  it  may  not  know  what  it 
wants  in  every  single  detail;  it  may  not  be  able  to 
design  the  sample,  it  may  not  have  an  adequate  frame 
from  which  to  draw  samples,  it  may  not  have 
questionnaire  design  expertise.  But  they  know  what 
their  objectives  are  and  know  what  kind  of  questions 
they  want  answered,  and  they  know  something  about 
the  level  of  precision  that  they  want  in  the  answers. 
One  proceeds  then  to  buy  the  nuts  and  bolts,  if  you 
will — to  ask  for  proposals  of  how  to  get  there  from 
here;  and  then  if  you  do  have  a  well-prepared  RFP 
that  sets  out  these  requirements  either  in  more  specific 
terms  or  less  specific  terms,  at  least  they  are  addressed 
and  then  the  contracts  process  may  be  adequate.  The 
problem  is  that  this  is  often  not  the  case.  Certainly,  in 
many  Federal  agencies,  the  expertise  is  not  there  to 
specify  these  steps.  The  grants  process  is  at  the  other 
end  of  the  spectrum  and  that  may  not  be  completely 
satisfactory  for  many  types  of  needs  either.  We  ought 
to  be  able  to  see  if  there  is  not  something  in  this  overall 
procurement  process  that  could  bring  together  some 
of  the  advantages  of  both  the  contracting  process  and 
the  grants  process  to  allow  more  give  and  take,  back 
and  forth,  between  the  non-Federal  expert  organiza¬ 
tion  and  the  Federal  agency  that  perceives  the  need. 

Tom  Jmler: 

Let  me  see  if  I  can  put  this  in  a  couple  of  questions 
and  then  react  to  some  of  the  panelists  views  which  I 
have  found  to  be  interesting.  One  is  the  general  issue 
which  Bob  Israel  raised  and  Morris  discussed  and  1 
think  they  are  exactly  opposite  poles.  Israel  says: 
specify  in  great  detail,  along  Cochran’s  9  points,  and 
Hansen,  as  I  read  him  says,  tell  us  in  general  what  you 
want  and  let  us  fiddle  around  with  the  nitty-gritty  and 
whether  we  use  the  left  or  the  right  hand  to  start  up 
with.  This  is  one  issue  which  is  a  very  important  one 
because  there  is  a  sense  in  which  it  is  the  only  way  for 
a  genuine  procurement  process  to  follow  the  princi- 
ples  of  specifications,  and  competitive  bidding.  The 
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very  broad  question  in  which  they  are  interested. 
They  want  to  know  something  about  the  health  status 
of  the  American  population  over  65;  they  want  to 
know  something  about  the  retirement  provisions  that 
people  actually  have  in  place.  If  you  start  to  push 
them  and  you  say  with  what  precision  do  you  need  to 
know  that,  they  will  doubtless  find  an  answer  for  you, 
but  that  is  not  what  they  are  after.  What  they  are  after 
is  how  to  administer  a  program  to  deal  with  retire¬ 
ment  provisions  of  individuals,  the  changes  in  health 
plans,  or  the  changes  of  legislation,  and  they  need  in¬ 
formation  in  general  about  things  that  are  really  very 
broadly  defined.  If  that  is  true,  then  I  think  I  would 
side  with  the  Hansen  view  and  say  the  right  way  to 
draft  an  RFP  is  a  two  liner:  (a)  we  need  to  know  more 
than  we  now  know  about  the  health  status  of  the  U.S. 
population  with  respect  to  certain  kinds  of  health 
characteristics;  and  (b)  we  have  $1.6  million  to  spend 
on  it.  What  can  you  do  for  us,  over  what  kind  of  time 
schedule  and  let  us  decide  who  among  you  can  do  a 
better  Job.  Now  that  is  a  very  long  way  from  an  RFP 
of  the  kind  I  have  ever  seen.  Those  are  the  ones  I  like, 
those  are  the  kind  to  which  you  respond,  and  those  are 
the  right  kind  from  my  point  of  view  because  it  does 
what  I  think  is  inevitable  in  the  process.  It  tells  the 
bidder  that  we  do  not  really  know  how  to  delineate 
this  problem.  We  are  not  going  to  tell  that  it  has  got  to 
have  certain  tensile  strength,  because  that  is  the 
hardware  model,  because  we  do  not  know  what  kind 
of  tensile  strength  we  are  supposed  to  have.  All  we 
know  is  that  we  need  to  know  more  about  a  set  of 
things  for  which  we  have  a  program  responsibility  and 
we  have  a  budget.  Almost  all  of  my  colleagues  say  one 
of  the  problems  is  that  everyone  sees  us  as  the  Cadillac 
of  the  survey  business  and  what  they  mean  by  that  is 
not  only  that  we  are  very  high  quality,  but  we  are  very 
high  cost.  We  are  obviously  high  cost,  we  also  are  ob¬ 
viously  high  quality.  But  we  always  lose  on  these 
things,  because  our  costs  are  too  high.  My  colleagues 
tell  me  that  is  a  farce,  our  costs  are  not  too  high,  our 
bid  costs  are  too  high,  but  our  real  costs  are  no  higher 
than  anybody  else’s  and  they  give  absurd  bids  and 
then  renegotiate.  There  is  a  sure  cure  for  that;  that  is, 
say  to  the  contractor  here  is  $1.6  million,  and  here  is 
the  problem  that  we  put  to  you.  You  tell  us  what  you 
are  going  to  do;  if,  by  God,  you  do  not  do  it,  do  not 
come  looking  to  us  for  more  than  the  $1.6  million.  If 
you  have  a  $2  million  overun,  that  is  your  problem. 

I'here  is  a  lot  to  be  said  for  a  system  that  tells  the  con¬ 
tractor,  the  budget  is  here;  do  not  tell  us  six  months 
later  about  all  the  problems  you  have  had;  think 
about  it  in  advance  and  be  prepared  to  undertake  the 
full  fruits  of  your  guessing.  We  suffer  from  that 
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sometimes,  and  so  does  everybody  else,  but  among 
other  things  it  would  stop  aU  of  the  rumor  which  may 
be  partly  true  about  the  fact  that  every  contract  that 
gets  let  out  is  in  fact  grossly  unfair  and  the  real  costs 
are  anywhere  from  50%  higher  to  double.  It  may  or 
may  not  be  true  but  a  lot  of  people  believe  it  and  that 
is  a  very  undesirable  characteristic  of  the  RFP  system. 
There  is  no  one  who  really  believes  that  the  dollars 
mean  dollars  because  you  cannot  find  the  dollars  in 
the  contract;  it  is  a  fiction — man  years,  equivalent 
this,  equivalent  that  and  you  renegotiate.  Doing  this 
the  other  way,  you  would  not  have  that  problem  and  I 
think  it  is  much  cleaner,  it  makes  a  competitive  bid 
really  bite,  and  I  do  not  guarantee  we  will  do  better 
with  that  kind  of  system,  but  I  think  it  is  a  better  way 
to  run  the  economy.  I  would  like  some  feedback  from 
the  panelists  about  (a)  how  they  really  feel  about  the 
specificity,  the  Israel  version  or  the  Hansen  version, 
and  (b)  whether  we  all  really  agree  that  it  does  not 
make  any  sense  to  write  an  RFP  without  putting 
dollars  up  front. 

Tom  Staples: 

First,  I  do  not  think  the  Hansen-lsrael  polarity  you 
suggested  is  that  much  different  in  terms  of  either  one 
wanting  to  do  it  the  same  way  for  all  types  of  con¬ 
tracts.  That  is  why  1  have  to  push  my  own  cart  for  a 
minute.  I  think  they  are  talking  about  very  different 
kinds  of  contracts  and  in  the  data  collection  kind  of 
contract  that  Bob  was  talking  about,  I  think  you  do 
want  specificity,  I  think  as  a  contractor  you  want  that 
specificity.  It  is  entirely  appropriate  for  the  RFP 
process  to  use  that.  On  the  other  hand,  the  kind  of 
question  you  posed  was  one  about  assessing  the  health 
status  of  the  population,  and  certainly  if  that  is 
general  question,  you  do  not  want  a  lot  of  specificity- 
built  around  it;  presumably  you  want  some  oppor¬ 
tunity  to  say  how  you  approach  the  subject.  1  suspect 
that  specificity,  or  lack  thereof  is  not  the  issue.  The 
issue  is  how  do  we  sort  these  things  so  that  the  govern¬ 
ment  and  the  contracting  community  work  on  re¬ 
quests  tailored  to  specific  pieces  of  work:  specificity 
when  we  need  it,  non-specificity  when  we  do  not. 

Boh  Israel: 

Before  we  go  too  far  in  discussing  a  Hansen  version 
and  an  Israel  version  1  do  want  to  clarify  one  thing, 
and  that  is  that  I  was  not  necessarily  advocating  the 
preparation  of  an  RFP  that  would  tell  the  prospective 
contractors  what  the  tensile  strength  ought  to  be  but 
only  that  we  ought  to  be  sure  we  tell  them  we  are  in¬ 
terested  in  tensile  strength.  There  is  a  difference,  and  I 
believe  that  brings  what  I  was  saying  a  little  closer  to 
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what  Morris  was  suggesting  in  terms  of  flexibility.  My 
points  were  more  as  a  reminder  that  these  are  things 
that  must  be  considered  not  necessarily  as  specific  or¬ 
ders  to  the  contractor  to  do  it  that  way. 

Tom  Juster: 

You  were  not  going  to  write  them  as  specifications, 
then,  you  were  going  to  say  that  we  are  concerned 
about  variances. 

Bob  Israel: 

Tell  me  how  you  are  going  to  solve  this  problem. 
Tell  me  how  you  are  going  to  solve  that  problem.  I 
want  to  know  what  kind  of  training  you  are  going  to 
provide,  if  any,  and  so  forth. 

Tom  Juster: 

I  thought  that  what  you  were  saying  was  you  were 
going  to  lay  out,  as  you  would  if  you  were  building  a 
bridge.  You  would  not  say  we  want  a  bridge  ‘kinda’ 
that  has  to  go  from  here  to  there.  You  say  the  bridge 
has  to  meet  certain  requirements,  it  must  be  built  in 
terms  of  very  rigid  engineering  specifications.  But  you 
are  not  talking  about  that. 

Boh  Israel: 

Well  I  am  and  I  am  not  because  I  think  the 
checklist  approach  allows  the  government  agency  to 
build  in  that  much  specificity  if,  in  fact,  it  knows  that 
is  what  it  wants  and  it  has  the  statistical  expertise  to 
spell  out  what  it  wants.  What  it  is  looking  for  under 
those  circumstances  is  to  buy  from  a  contractor,  if  you 
will,  the  contractor’s  ability  to  carry  out  this  level  of 
specificity.  On  the  other  hand,  it  need  not  be  that 
way,  but  at  least  one  should  be  sure  that  the  RFP  is 
not  a  two  liner,  because  I  really  think  that  nobody  in 
the  final  analysis  is  going  to  be  satisfied  with  the 
product  that  comes  from  a  two-line  RFP.  The  con¬ 
tractor  will  be  disappointed  because  the  Federal 
agency  will  say  that  is  not  what  it  meant  at  all. 

Morris  Hansen: 

1  think  Bob  Israel’s  interpretation  of  what  he  is  say¬ 
ing  fits  well  enough  with  mine.  I  am  not  suggesting  a 
two-line  RFP;  I  welcome  seeing  in  an  RFP  whatever 
the  agency  has  thought  through.  I  am  often  unhappy 
when  the  RFP  says  “This  is  what  you  do,’’  although  if 
it  says  “This  is  what  you  do”  in  considerable  detail  as 
a  means  of  providing  a  framework  to  start  from,  I 
think  that  is  desirable,  assuming  it  is  not  a  straitjacket 
in  which  you  must  stay.  But  there  is  an  important 
point  where  I  would  disagree  with  Tom  Juster  in  a 
rather  substantial  way:  he  mentioned  that 'he  would 
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like  to  have  this  two-line  RFP  state  the  amount,  and 
then  the  contractor  should  deliver  the  product  for  that 
amount,  and  if  it  costs  him  two  million  dollars  more 
he  should  absorb  it.  As  a  practical  matter  that  is  not 
what  is  going  to  happen.  It  sounds  like  the  guy  who 
gets  a  manager  and  turns  the  job  over  to  him  and  says, 
“Produce  and  we  will  raise  your  salary  if  you  do,  or 
you  are  fired  if  you  do  not.” 

I  think  we  meet  the  needs  of  a  contract  sponsor  if  he 
specifies  in  great  detail,  if  the  contractor  feels  free  to 
make  a  bid  on  the  basis  of  that  kind  of  detail,  but 
should  then  have  a  flexible  approach  in  the  way  the 
sponsor  works  with  the  contractor.  The  contractor 
can  then  say,  “Look,  you  specified  a  bunch  of  things 
here  that  we  think  we  could  do  better  this  way.” 
There  ought  to  be  a  system  of  interaction  and  ap¬ 
proach  that  permits  serving  the  interests  of  the 
government  best.  My  worry  about  the  effort  to  treat 
contractors  equally  is  that  it  leads  you  to  believe  that 
you  can  award  a  contract  without  making  a  Judgment, 
that  you  can  look  at  the  dollars  they  bid  for  what  is 
supposed  to  be  the  same  product,  but  it  is  not,  and 
you  take  the  easy  way  out  by  taking  the  lowest  bid 
among  contractors.  1  think  this  is  a  vicious  practice 
that  leads  to  inadequate  proposals  and  poor  perfor¬ 
mance.  I  do  not  think  most  Jobs  involving  innovative 
work  can  be  carefully  thought  through  and  bid  in  a 
three-week  period.  Ordinarily,  contracting  for  a  sur¬ 
vey  should  not  be  approached  in  the  way  that  puts 
down  the  details  word  for  word  in  the  specifications 
and  in  the  contract,  which  are  now  God’s  word 
because  the  contract  has  been  signed.  Rather,  it 
should  be  an  interactive  process  that  tries  to  produce 
for  the  government  the  most  that  can  be  done 
reasonably  to  meet  the  objectives;  and  modify  the 
system  in  desirable  ways  through  interactive  discus¬ 
sion  and  agreement  as  the  project  proceeds.  Then  if  it 
is  not  found  desirable  to  modify  the  initial  plan  it 
means  you  did  a  good  Job  or  the  government  had 
already  specified  a  good  Job,  and  that  is  fine. 


George  Hall: 

Morris  let  me  ask  you  a  question  because  there  is 
something  that  has  been  said  here  by  both  you  and 
Tom  Juster  that  seems  to  be  contradicted  by 
something  that  Tom  Staples  said.  You  are  saying,  and 
1  understand  you  cannot  do  a  great,  huge  Job  in  zero 
time.  But  Tom  Juster  is  concerned  with  the  fact  that 
with  RFP’s  perhaps  you  only  get  one  in  five.  There  is 
a  fairly  sizable  investment  that  has  to  be  amortized 
some  way.  At  the  same  time,  if  1  follow  both  of  you, 
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the  contractor  really  ought  to  develop  a  very  detailed 
product  which  can’t  be  done  in  a  very  short  time.  I 
wonder  if  that  is  feasible  too?  It  seems  to  me  that  Tom 
Staples  said  that  there  is  the  development  phase, 
which  is  often  fairly  extended  and  takes  a  fair  amount 
of  resources  and  a  fair  amount  of  money.  Is  there  not 
some  kind  of  dilemma  that  can  pose  a  problem? 

Tom  Juster: 

I  think  there  is  an  apparent  dilemma  but  in  fact  I  do 
not  really  believe  there  is  an  actual  dilemma,  if  you 
were  to  do  things  along  sensible  strategies  and 
procedures.  If  you  really  are  doing  the  kind  of  thing 
which  1  would  characterize  as  a  production  run  with 
well  defined  specifications,  I  do  not  think  you  need 
more  than  a  fairly  short  period  of  time  to  put  together 
a  technical  cost-oriented  response  for  anyone  to  go  out 
to  build  this  bridge.  The  man  wants  ten  thousand  sur¬ 
veys,  he  wants  to  measure  this,  that,  and  the  other 
thing,  with  certain  variances,  with  certain  “thises” 
and  “thats”,  fine,  this  can  be  produced  because  all 
problems  have  been  defined  away;  all  the  specifica¬ 
tions  have  been  written  out.  That  is  a  sensible  strategy 
for  a  competitive  bid  contract.  If  what  you  want  to  do 
is  get  someone  to  think  about  your  problem,  which  is 
what  most  agency  RFP’s  are,  you  do  not  want  a  com¬ 
petitive  bid.  It  is  silly  because  there  you  want  someone 
to  be  able  to  make  the  Judgment  on  the  basis  of  what 
people  have  expressed  in  the  proposal.  You  cannot  ex¬ 
pect  them  to  think  seriously  about  your  problems  in 
three  weeks.  They  are  not  going  to  do  it  and  either  you 
have  to  say  we  know  so  and  so  is  interested  in  our 
problem  and  we  will  go  negotiate  with  him,  or  you 
could  write  an  RFP,  as  I  have  seen  on  occasion,  which 
says  we  are  interested  in  negotiating  a  sole  source  con¬ 
tract  with  somebody  about  this  problem.  This  latter 
alternative  requests  that  ten  pages  be  written  to 
describe  this  problem;  this  response  is  used  as  a  basis 
for  deciding  who  is  likely  to  be  (a)  inventive;  (b) 
responsive;  (c)  capable;  and  so  forth;  then  a  sole 
source  contract  is  negotiated.  I  agree  entirely  with 
Morris  that  to  do  work  for  a  Federal  agency,  it  is 
crucial  for  the  contractor  and  the  agency  to  have 
friendly,  congenial,  and  elaborate  discussions  about 
what  their  mutual  interests,  needs  and  capacities  are 
and  to  design  the  work  so  that  the  contractor  has  an 
input  into  how  it  gets  done  because  he  or  she  feels  that 
they  have  something  to  offer  and  the  agency  has  the 
feeling  that  they  are  going  to  get  what  they  need.  The 
RFP  notion,  nevertheless,  is  simply  not  consistent 
with  that.  The  sole  source  bid  notion  is  consistent 
with  it. 
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Morris  Hansen: 

I  disagree  with  that,  Tom.  One  of  my  points  of  dis¬ 
agreement  with  you  is  that  it  seems  as  though  because 
you  and  I  agree  on  some  major  points  (that  the  dollars 
should  be  specified,  and  that  it  should  be  an  interac¬ 
tive  process),  that  leads  you  to  the  conclusion,  it 
seems,  that  they  should  not  be  competitively  bid.  You 
seem  to  interpret  “competitive  bidding”  as  meaning 
you  choose  a  fixed  product  on  the  basis  of  the  dollars, 
although  occasionally  that  will  have  some  advantage. 

Tom  jfuster: 

Morris,  1  think  we  are  both  going  to  agree,  that  we 
choose  on  the  basis,  given  dollars,  of  indicated  quality. 

Morris  Hansen: 

.\nd  I  regard  that  as  competitive  bidding  to  see 
what  ideas,  what  resources  you  bring;  the  capabilities 
are  part  of  it  and  are  part  of  the  selection  process.  It 
will  not  always  be  perfect.  Many  times  I  thought  it 
was  incredible  to  be  expected  to  do  the  job  of  prepar¬ 
ing  a  proposal  in  the  time  available.  You  cannot  really 
face  up  to  the  issues  and  do  it  effectively  if  you  think  of 
it  as  a  competitive  bidding  for  a  dollar-award  kind  of 
thing.  But  if  you  look  at  it,  as  I  tried  to  point  out,  as  a 
way  to  indicate  your  capabilities  and  the  resources 
you  bring  to  it,  the  kinds  of  ideas  that  you  have  with 
respect  to  it,  and  make  an  initial  proposal,  and  then 
iet  it  evolve  in  more  specific  detail  later  on,  I  think  that 
is  an  effective  way  to  proceed.  I  guess  I  am  afraid  if 
you  lengthen  the  time  interval  it  would  be  worse 
because  then  your  time  and  cost  spent  on  proposals 
would  be  greatly  increased.  There  is  another  way  to 
do  it,  however,  and  that  is  to  issue  a  purchase  order  to 
one  or  more  groups  to  design  something  for  you,  to  do 
some  of  the  developmental  work — in  effect  not  to 
prepare  a  bid  but  to  do  the  designing  and  the 
background  work  that  would  make  it  possible  to 
prepare  a  bid.  It  might  be  desirable  to  issue  three  or 
four  of  those  purchase  orders  and  then  let  the  results 
be  in  the  public  domain,  and  then  ask  for  bids,  and 
still  have  this  interactive  approach,  because  no  one  is 
able  in  advance  to  deal  with  all  the  issues. 

Boh  Israel: 

Let  me  add  just  a  little  bit  more  about  this  com¬ 
petitive  process.  I  do  not  know  whether  the  experience 
of  NCHS  is  typical  or  atypical  but  we  have  certainly 
on  occasions  found  our  contracting  office  quite  willing 
to  merely  exclude  the  outliers  in  terms  of  price  and 
allow  the  selection  to  be  on  the  basis  of  a  technical 
evaluation,  so  that  it  does  not  come  down  to  the 
twenty-five  thousand  dollars,  more  or  less,  on  a 
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million  dollar  contract.  But  the  other  thing  1  want  to 
point  out  is  that,  again,  1  do  not  know  if  our  depart¬ 
ment  is  typical  or  not,  but  we  now  must  justify  a  sole 
source  contract  only  on  the  basis  that  there  is  one  and 
only  one  organization  that  can  do  a  particular  job.  If 
there  is  more  than  one,  there  is  no  way  on  earth  to 
justify  sole  source.  That  is  why  I  was  saying  earlier 
that  we  need  to  be  looking  for  some  modification  of 
the  mechanism  itself,  whether  it  be  contract  or  grant 
or  some  intermediate  process  where  you  can  have  this 
interactive  process;  you  can  talk  to  the  prospective 
bidders,  you  can  deal  with  them.  I  do  not  see  any  way 
of  saying  that  Morris’  organization  or  Tom’s 
organization  is  the  only  one  in  the  United  States  that 
can  carry  out  survey  X.  Therefore,  it  seems  to  me  that 
at  least  for  our  office,  there  is  no  way  to  do  a  sole 
source  contract  of  this  type. 

Tom  Staples: 

I  think  that  is  right  Bob.  I  think  one  of  the  things  we 
have  to  deal  with  is  being  able  to  develop,  from  a 
technical  and  program  standpoint,  which  mechanism 
makes  the  most  sense.  I  do  not  know  that  the  business 
office  per  se  will  always  have  that  information,  they  do 
not  know  necessarily  about  the  maturity  of  the  work 
carried  out,  nor  what  is  the  level  which  this  needs  to 
be  pitched.  In  absence  of  that  kind  of  information  it  is 
almost  impossible  to  make  the  distinction  that  is 
necessary  to  do  sole  source  contracting.  Therefore,  it 
seems  to  me  we,  call  it  what  you  will,  need  to  have 
flexibility  to  choose  among  the  various  mechanisms.  It 
does  no  good  for  us  to  say  there  should  be  alternative 
mechanisms  that  can  be  tailored  to  the  needs  if  we  are 
very  limited  in  terms  of  being  able  to  use  those 
mechanisms.  We  first  have  to  clearly  establish  that 
there  are  a  wide  range  of  available  mechanisms. 

■Secondly,  I  want  to  get  back  to  the  point  that 
(Jeorge  kicked  us  off  with.  We  were  talking  about 
agency  newcomers.  We  talked  about  someone  who 
wanted  to  do  a  piece  of  work  and  does  not  have  the  ex¬ 
pertise  to  know  how  to  do  that.  We  have  not  really  ad¬ 
dressed  that  question.  What  does  happen  in  that 
instance? 

Morris  Hansen: 

I  thought  we  did  address  that  by  suggesting  that 
they  would  be  a  lot  better  off  if  they  would  describe 
the  product  needed,  with  details  to  the  extent  they 
have  been  thought  through,  and  indicate  the  amount 
of  funds  available.  I  would  not  go  as  far  as  Tom  Juster 
put  it.  It  may  be  sufficient  to  indicate  the  amount  of 
funds  you  have  available,  the  nature  of  the  problem, 
and  the  kinds  of  things  to  be  done,  and  the  kinds  of 
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check-points  that  should  be  given  attention,  that  Bob 
Israel  mentioned. 

George  Hall: 

I  would  like  to  make  one  observation.  It  seems  to 
me  that,  I  think  inadvertantly,  Tom  Juster  has 
become  a  red  herring.  The  reason  I  say  inadvertantly 
and  red  herring  is  the  process  that  he  was  describing 
where  he  asked  a  number  of  people  to  come  in  with  a 
ten  page  idea  plan;  and  then  on  the  basis  of  that  he 
said  he  would  go  out  and  negotiate  the  sole  source 
contracts.  I  think  what  he  did  was  to  go  into  a  com¬ 
petitive  kind  of  thing  in  the  first  place.  If  you  do  not 
really  negotiate  a  sole  source  contract  at  that  point, 
simply  negotiate  and  you  give  somebody  an  award. 
That  does  not  stand  as  any  kind  of  sole  source  con¬ 
tract  process,  that  stands  like  a  true  competitive 
process. 

Tom  Juster: 

Let  me  get  at  the  competitive  business  which  I  do 
not  really  think  is  handled  by  Morris’  picture.  Are  you 
really  in  competition  if  you  sit  up  there  and  say  here 
are  the  dollars  and  let  us  evaluate  on  quality?  It  is  true 
that  you  get  something  that  is  generally  called  com¬ 
petitive  bidding.  It  is  also  true  it  is  a  much  better 
mechanism  from  a  variety  of  points  of  view  because  of 
its  receptivity. 

I  go  back  to  where  this  all  starts  from  in  the 
procurement  process.  If  you  want  to  decide  whether 
the  people  said  they  built  you  a  sewage  plant,  you 
have  the  plant  there,  and  either  the  sewage  runs 
through  or  it  does  not  run  through.  Who  goes  back 
and  decides  after  having  let  a  bid  out  on  the  basis  of 
here  are  the  dollars  and  you  tell  us  what  you  are  going 
to  do  for  quality;  who  goes  back  and  looks  at  track 
record?  I  do  not  know  the  answer  to  that;  my  guess  is 
the  answer  may  be  nobody  does.  If  you  were  to  ask  the 
agencies  what  it  is  they  buy  from  all  the  procurements 
that  they  do  in  RFP’s,  ask  them  how  do  they  gauge 
the  quality  of  the  product  and  the  promises  that  were 
made  and  compare  the  original  cost  and  the 
renegotiated  cost,  my  guess  is  that  you  would  find  an 
awful  lot  of  slippage  between  what  it  was  that  was 
said  would  be  done  for  the  price  and  what  was  ac¬ 
tually  done  and  the  use  the  agencies  found  for  it,  and 
the  quality  standards  that  were  actually  put  in  place. 
It  is  a  very  different  proposition  than  walking  across  a 
bridge  and  deciding  that  it  is  not  going  to  collapse.  In 
the  social  sciences,  it  is  my  impression,  there  is  vir¬ 
tually  no  serious  post-evaluation  of  those  competitive 
bid  processes  and  without  doing  that  you  don’t  have  a 
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competitive  process.  Unless  you  evaluate  the  outcome 
all  you  are  doing  is  saying  here  is  a  dollar  figure, 
which  is  better  than  saying  here  is  a  bunch  of  man 
years,  but  you  still  do  not  have  a  competitive  process 
which  is  supposed  to  eliminate  firms  that  do  not 
produce  up  to  par. 

Tom  Staples: 

I  think  you  are  basically  right,  but  I  have  great  dif¬ 
ficulty  knowing  how  to  write  the  standards  for 
evaluating  social  science  results. 

Tom  Juster: 

This  is  why  RPF’s  do  not  work. 

Tom  Staples: 

Then  we  are  in  agreement  that  an  RFP  has  serious 
limitations  in  terms  of  what  is  appropriate  for  them. 
What  we  need  to  be  looking  for  is  other  mechanisms 
to  get  other  information.  I  think  we  feel  that  we  are 
seriously  limited  in  that  way.  It  is  not  because  of  a  law 
that  says  “Ye  shall  not  do  it  that  way”.  A  lot  of  the 
problem  is  tied  back  to  the  business  constraints  and 
that  sort  of  thing.  But  no,  I  think  as  a  government,  as 
a  community  of  social  science  researchers  and  people 
involved  in  the  area,  we  can  do  something  to  assure 
that  appropriate  contracting  mechanisms  are  avail¬ 
able.  I  do  not  think  it  has  to  be  the  way  it  now  is. 

George  Hall: 

I  have  been  sitting  here  listening  to  the  cost 
overruns,  and  social  science  research,  but  I  cannot 
really  escape  the  thought  that  keeps  running  through 
my  mind  “C5A”.  We  do  have  a  very  serious  problem 
here.  I  think  we  can  identify  a  number  of  issues  in 
which  there  seems  to  be  general  agreement  and  one  of 
them  is  the  business  of  making  available  to  Federal 
contractors  some  notion  of  what  kinds  of  resources  are 
available.  Most  of  the  people  say  that  at  least  that 
would  guarantee  some  new  formative  approach  such 
as  what  Tom  Staples  says  he  normally  does.  He  gets 
rid  of  the  outliers,  which  might  sometimes  result  from 
some  sort  of  misunderstanding  in  the  specifications. 

QUESTIONS  FRO.M  THE  AUDIENCE 

Question: 

This  question  goes  back  to  an  issue  Tom  Juster 
touched  on  in  his  initial  remarks;  that  is,  the  possible 
problem  that  surveys  are  fragmented,  that  you  have 
one  procurement  for  design,  one  for  data  collection, 
one  perhaps  for  data  processing,  and  so  forth.  Is  this 
really  a  serious  problem?  If  it  is,  what  can  we  do  about 
that? 
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Tom  Jusler: 

Let  me  tell  you  a  funny  story.  An  agency  produced 
an  RFP  which  we  thought  was  very  interesting.  As  a 
matter  of  fact  we  even  thought  it  might  have  been 
wired  for  us  because  of  reasons  1  will  not  go  into.  It 
did  have  a  few  things  to  suggest — sample  design  was  a 
task  to  be  bid  separately  So  in  my  dreams  1  en¬ 
visioned  VVestat  interviewers  trampling  through 
.SRC’s  primary  sampling  units  using  NORC’s 
questionnaire  designed  for  NORC’s  interviewers.  We 
wondered  what  was  going  to  be  the  possible  outcome i* 
We  responded  to  that  one  and  suggested  that  we 
would  have  a  lot  lower  cost  if  we  did  the  whole  thing 
ourselves  and  our  cost  would  balloon  if  we  had  to  do  it 
all  separately  and  we  were  kind  of  Judged  high  cost 
and  unresponsive.  It  does  happen  and  goes  back  to 
what  I  said  before — people  who  design  RFP’s  on  the 
|)rocurement  side  somewhere  in  the  Federal  system 
really  do  believe  that  it  does  not  make  any  difference 
who  designs  the  sample  and  who  designs  the  instru¬ 
ment,  and  who  collects  the  data,  and  who  does  the 
analysis.  .\ny  social  scientist  that  believes  that  has  not 
done  any  empirical  work  recently.  1  do  not  think  it  is  a 
pervasive  problem.  But  I  do  think  in  this  case  it  was 
not  the  agencies’  preference;  I  think  it  was  forced  on 
them  by  their  contract  people  and  they  simply  had  no 
choice  about  it.  They  knew  it  was  silly,  we  knew  it  was 
silly,  but  it  was  done. 

Morris  Hansen: 

Well,  I  would  have  to  differ  a  little  bit  on  that.  I  am 
not  sure  that  it  is  as  silly  as  you  make  it  sound.  If  in¬ 
deed  you  have  a  job  and  you  know  what  it  is  and  you 
want  to  get  it  done  in  a  relatively  short  time  period 
and  it  has  been  thought  through  pretty  well,  it  seems 
to  me  there  is  only  one  way  to  go  and  that  is  with  an 
integrated  kind  of  award.  But  if  you  want  to  have 
some  interactive  ideas,  and  possibly  have  input  from 
an  interaction  with  more  than  one  group,  and  you 
have  the  time  and  can  pay  the  additional  cost,  it  may 
well  be  worth  it  to  award  an  initial  design  contract  to 
do  a  lot  of  the  basic  thinking  on  various  aspects  of 
total  survey  design,  including  sampling.  It  may  pay  to 
award  more  than  one. 

This  might  be  followed  by  a  contract  for  completing 
details  of  design,  sample  selection,  and  data  collec¬ 
tion.  I  think  it  would  likely  produce  a  better  job  than  a 
single  integrated  contract.  If  you  can  afford  that  kind 
of  luxury,  it  has  advantages  over  just  doing  it  with  one 
big  |)ush.  .Again,  the  analysis  of  the  survey  results  is 
sometimes  a  report  by  the  contractor  that  collects  the 
data;  sometimes  it  is  a  tape  for  use  by  many  people.  It 
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is  desirable  to  have  both.  The  analysis  is  not 
something  that  can  be  done  only  by  people  who  work 
on  the  survey.  They  may  have  some  special  insights  of 
which  it  is  well  to  take  advantage;  others  may  add 
much  in  analysis.  I  do  not  think  good  analysis  is 
necessarily  a  result  of  a  single  integrated  operation. 

George  Hall: 

Morris  let  me  ask  you  a  question.  I  have  seen  some 
agencies  who  go  through  this  business  of  having  a 
design  contract  and  then  the  subsequent  contract  to 
actually  conduct  the  survey  or  what  have  you.  I  have 
seen  some  cases  where  the  design  contractor  is  not 
permitted  to  bid  on  that  final  contract.  Is  that  a 
problem? 

Morris  Hansen: 

I  have  not  seen  them  offered  that  way;  it  seems  to 
me  that  is  undesirable.  Having  done  the  design  may 
give  the  initial  contractor  an  inside  track.  However, 
sometimes  it  is  a  negative  inside  track;  sometimes  a 
positive  one. 

George  Hall: 

The  reason  1  mentioned  it  is  that  you  and  Tom 
Juster  were  both  talking  about  small  purchase  orders 
to  do  some  design  work  and  the  procurement  officer 
said:  Look,  if  you  do  that,  what  you  have  done  is  to 
provide  that  particular  group  with  a  leg  up  on  the 
overall  contract.  Therefore,  they  will  not  be  allowed  to 
bid  on  the  overall  contract,  so  they  can  be  awarded  a 
small  design  contract  but  cannot  do  the  larger  work. 

Morris  Hansen: 

This  is  what  I  was  objecting  to  a  little  while  ago.  If 
it  operates  this  way  the  government  is  really  holding 
the  position  of  being  sure  that  they  are  fair  to  contrac¬ 
tors  instead  of  trying  to  work  in  the  best  interest  of  the 
government.  It  seems  to  me  that  government  procure¬ 
ment  ought  to  be  done  for  the  best  interests  of  the 
government,  and  that  you  need  to  let  the  system 
evolve  in  a  way  that  makes  that  basic.  With  respect  to 
your  particular  point,  it  is  not  at  all  necessary,  if  you 
have  a  purchase  order  for  a  design  contract,  that  you 
may  not  bid  on  the  survey  contract.  I  can  illustrate. 
We  were  asked  to  do  and  did  a  design  contract  under 
a  purchase  order  that  turned  around  completely  the 
way  the  agency  was  thinking  about  the  problem.  They 
liked  the  result  enormously  and  they  put  out  an  RFP 
and  expected  us  to  bid  on  it,  and  we  could  have  except 
that  the  contracting  office  made  it  a  small-business 
“set-aside,”  on  which  we  could  not  bid.  .At  the  time  I 
thought  it  was  incredible  because  I  thought  an  eligible 
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small  business  v.fould  not  be  able  to  do  the  remaining 
design  work,  but  they  did  indeed  go  to  a  highly  com¬ 
petent  consultant  who  set  up  the  system  for  them  and 
workfed  with  them,  and  I  think  probably  they  did  a 
quite  creditable  job.  It  was  a  divided  project,  and 
probably  not  too  badly  divided. 

Quest  ion —  T ed  Woolsey : 

Every  time  I  read  the  newspapers  about  senators 
and  congressmen  raising  a  question  about  Federal 
monies  the  Federal  government  is  spending  on  con¬ 
sulting,  I  take  that  to  mean  the  work  and  the  amount 
that  they  spend  on  contracted  research  as  well  as  solv¬ 
ing  problems.  I  wonder  about  the  fundamental  ques¬ 
tion  of  whether  the  Federal  government  gets  its 
money’s  worth  in  contracted-out  surveys.  My  com¬ 
ment  would  be  limited  on  that  subject  to  these  two 
things  which  are  specific  and  which  I  think  help  to 
assure  that  the  government  gets  its  money's  worth. 
The  first  is  to  pick  up  on  something  that  Tom  Staples 
said,  that  is,  that  there  is  an  enormous  distinction  be¬ 
tween  the  kinds  of  agencies  contracting  and  some  of 
them  now  are  contracting  out  some  research  as  the 
only  way  that  they  can  practically  get  it  done.  They 
Just  do  not  have  the  skills  on  their  own  staff  to  get  the 
work  done.  They  will  get  it  done  and  get  it  done  better 
if  they  spend  almost  any  amount  of  money  to  have  it 
done  by  an  outside  firm.  I  am  not  sure  that  is  true 
when  we  talked  about  sample  surveys,  when  we  are 
talking  about  those  agencies  in  the  Federal  govern¬ 
ment  whose  function  is  collecting  statistics  and  that  is 
all,  where  they  would  normally  have  a  great  many  of 
the  skills  themselves,  but  the  one  thing  they  do  not 
have  is  the  manpower.  My  feeling  is  that  there  are 
many  instances  where  the  government  is  shortsighted 
in  limiting  the  ceilings  that  the  agencies  can  fill;  they 
are  forced  to  go  to  the  contract  route  to  get  work  done 
because  they  cannot  hire  people  to  do  it  themselves.  If 
they  could  hire  those  people,  we  could  get  the  same 
work  done  better  for  less.  1  have  never  understood  this 
feeling  on  the  part  of  OMB  that  ceilings,  whether  it  is 
temporary  employees  or  full-time  employees,  have  to 
be  so  tight.  I  am  sure  that  is  a  political  question  that 
does  not  make  economic  sense. 

Second,  when  the  Federal  government  does  spend 
its  money  on  contract  research  and  contract  surveys 
and  so  on,  it  ought  to  find  a  better  way  of  timing  that 
process.  I  think  there  is  abundant  evidence  that  when 
an  agency  goes  through  a  normal  process,  which  is 
a  wait-to-see-what-their-budget-is-going-to-be,  part¬ 
way  through  the  fiscal  year,  they  spend  part  of  their 
budget,  and  they  find  out  how  much  they  have  left, 
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and  then  starting  around  half  or  two-thirds  way 
through  the  fiscal  year  they  say,  well  we  have  some 
money  left;  let  us  spend  it  on  contract  res'  arch.  Then 
they  go  out  and  dream  up  some  ideas  and  they  crash 
them  through  the  contracts  people’s  offices,  making 
them  spend  all  night  working  to  get  the  stuff  ready, 
and  they  come  up  with  rotten  RFP’s  and  they  get 
rotten  proposals  as  a  result  of  these  rotten  RFP’s. 
They  come  so  late  that  you  cannot  do  any  kind  of 
work  on  them.  Granted,  if  you  extended  the  amount  of 
time  in  an  unlimited  manner  this  would  Just  mean 
that  the  contractor  would  take  more  time  to  prepare 
his  proposal,  whether  it  is  a  university  or  a  private 
firm,  and  would  spend  even  more  of  the  budget  on 
preparing  a  proposal.  But  I  think  there  is  a  happy 
medium  there.  Right  now,  the  worst  ones  that  I  see 
are  ones  where  the  time  allowed  is  simply  not  suf¬ 
ficient  to  prepare  a  good  proposal.  I  think  that  can  be 
avoided  if  more  sensible  ways  of  allocating  the  money 
out  of  the  budgets  of  the  Federal  agencies  could  be  at¬ 
tained. 

Tom  Staples: 

It  is  really  tied  to  an  annual  appropriation  process 
and  we  would  need  a  different  kind  of  appropriation 
process  to  ever  get  past  the  time  problem. 

Ted  Woolsey: 

Well,  I  know  that  HEW,  at  one  time,  had  a  provi¬ 
sion  that  a  certain  amount  of  money  to  be  spent  on 
contracts  had  to  be  spent  during  each  quarter  of  the 
fiscal  year.  The  first  substantial  violator  of  that  was 
the  Office  of  the  Secretary.  But  I  think  something  of 
that  kind,  that  will  force  the  agencies  to  spread  their 
money  out  and  let  their  contracts  out  more  evenly 
through  the  year  would  help  greatly  to  make  that  tim¬ 
ing  more  bearable. 

(ieorge  Hall: 

I  would  like  to  say,  now  that  I  have  left  OMB  and 
the  statistical  policy  process  and  so  forth,  and  have 
gone  to  Census,  I  know  what  you  are  talking  about  in 
the  need  for  position  flexibility.  This  is  a  real  problem. 
1  recall  Just  a  year  ago  I  was  on  my  way  to  San  Diego 
and  joe  Waksberg  was  talking  to  me  about  the  same 
thing.  .Apparently,  a  number  of  RFP's  had  come  to  his 
attention,  all  of  which  would  have  been  appropriate 
for  Westat  to  perform  on.  But  there  is  simply  no  time 
to  develop  any  kind  of  basic  response  to  the  set-up. 
They  had  to  pick  and  choose,  even  though  the  firm 
could  have  performed  on  all  of  them.  There  was  Just 
not  time  to  prepare  a  proposal.  Is  there  an  answer  to 
thisi*  It  is  very  easy  for  us  to  sit  and  say,  “Well,  by 
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God,  you  do  not  start  after  your  budget  is  passed;  you 
start  thinking  at  some  other  time  and  perhaps  the 
passage  of  the  budget  could  trigger  the  sending  of 
RFP’s.”  But  the  point  you  made  is  a  very  real  one, 
that  many  agencies  are  looking  at  the  residual,  and 
when  there  is  some  money  left,  rather  than  return  it  to 
the  Treasury,  they  decide  to  go  out  and  do  some  con¬ 
tract  research.  I  suspect,  personally,  that  that  is  a 
serious  problem. 

Tom  Staples: 

Well,  I  think,  George,  that  this  is  a  basic  problem 
from  the  viewpoint  of  the  contractor  as  well  as  the 
government,  but  I  am  still  concerned  that  the 
Questioner  is  right,  that  the  agencies  should  do  more 
to  spread  the  amount  of  contracts  over  the  year.  But  it 
is  not  a  problem  of  the  program  office  not  having 
thought  too  much  about  what  they  wanted  to  do  next 
year,  and  not  having  the  criteria  laid  out,  because  they 
usually  have  that  done  two  years  in  advance.  The 
problem  is  that  the  business  office  simply  cannot 
begin  that  new  year’s  activity  until  they  get  into  that 
year.  .And  then  they  get  into  the  details  of  the  con¬ 
tracting  process  which  takes  a  minimum  of  three  but 
more  like  six  months  these  days. 

Boh  Israel: 

There  is  another  aspect  to  this  and  that  is  that  if 
you  can  get  the  contracting  office  to  agree  to  do  a  lot  of 
the  processing  of  the  paperwork  for  a  contract  1  won¬ 
der  how  many  prospective  bidders  would  be  willing  to 
do  the  work  of  preparing  a  proposal  before  a  state¬ 
ment  that  says  “subject  to  the  availability  of  funds.” 
\’ou  have  already  heard  that  win  rate  of  about  20%  as 
it  is  now  and  if  there  were  a  lot  of  proposals  out 
without  any  guarantee  that  eventually  the  funding 
would  be  there  1  wonder  how  much  additional  effort 
and  investment  would  be  put  into  the  development  of 
good  bids. 

Ted  W’oolsey: 

it  seems  to  me  a  very  simple  thing  that  Statistical 
Policy  could  do  to  shed  some  light  on  this  would  be  to 
do  a  quick  distribution  of  RFP’s  for  surveys  by  month 
in  which  they  were  issued. 

(ienrge  Hall: 

Perhaps  the  Federal  government  should  start  look¬ 
ing  into  something  like  annual  appropriations  and 
two  year  money. 

Tom  Staples: 

^’es,  1  think  that  is  the  kind  of  solution,  George,  that 
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is  the  only  thing  that  could  improve  the  situation. 
Tom  Jus  ter: 

Let  me  Just  make  a  brief  comment  on  the  first  part 
of  your  comment  which  has  to  do  with  contracted 
versus  in-house.  If  you  are  dealing  with  data  collec¬ 
tion,  you  are  essentially  talking  about  the  Census 
versus  the  rest  of  the  world,  in  terms  of  who  does  the 
work.  If  it  is  in-house,  it  is  presumably  done  by 
Census.  Well,  that  is  true  of  a  great  bulk  of  things 
where  the  options  essentially  look  alike,  if  the  govern¬ 
ment  specifies  the  data. 

Ted  W’oolsey: 

.Survey  research  is  not  always  done  in  household 
samples. 

Tom  Juster: 

1  am  thinking  of  a  wide  variety  of  Federal  surveys.  I 
think  of  the  Census  Bureau  as  the  government  collec¬ 
tion  agency. 

Tom  Staples: 

W'hat  Ted  is  saying  is  that  you  do  not  have  to  do 
direct  interviews,  I  guess;  mail  surveys,  whatever. 

Tom  Juster: 

I  understand  that,  but  the  Census  Bureau  is  the 
government’s  data  collection  agency. 

Ted  W'oolsey: 

I  do  not  think  that  is  yet  true. 

Tom  Juster: 

Well,  it  is  by  and  large  true.  But  what  I  was  going 
to  say  is  that  it  seems  to  me  that  whether  it  should  be 
contracted  out  to  somebody  else,  whether  it  be  a  con¬ 
sulting  based  organization,  or  a  university  based 
organization  or  whether  it  should  be  done  in  some 
sense  by  the  Federal  establishment,  in  my  terms, 
provided  by  the  Census  Bureau,  it  seems  to  me  largely 
a  matter  of  whether  you  are  talking  about  something 
that  is  developmental  or  operational.  Nobody  has  to 
ask  me  to  do  operational  data  for  program  needs  that 
the  Census  Bureau  has  simply  the  bulk  and  the  size 
and  the  capacity  and  the  talent  and  skills  to  do  it.  On 
the  other  hand,  you  ask  the  Census  Bureau  to  do 
developmental  work  and  the  bureaucracy,  which  is 
never  supposed  to  produce  but  large  scale  operational 
kinds  of  things,  will  really  slow  you  down  very  greatly. 
My  sense  of  it  is  that  I  have  done  some  work  for  them 
as  have  many  people  and  the  Census  is  extraor¬ 
dinarily  good  and  very  efficient  at  the  kind  of  thing 
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they  do,  but  they  are  relatively  inflexible  and 
relatively  rigid  about  small  scale,  developmental  kinds 
of  things;  the  things  we  are  talking  about  here  fit  more 
in  the  developmental  mode  and  I  really  do  not  think  I 
see  any  advantage  in  essentially  having  those  chan¬ 
neled  through  a  Federal  system  as  opposed  to  con¬ 
tracted  out  to  sombody  who  could  move  more  quickly, 
and  that  was  likely  to  have  a  different  kind  of  people 
with  notions  that  might  be  useful  to  the  process. 

Ted  Woolsey: 

I  was  not  limiting  my  comments  to  the  developmen¬ 
tal  phase.  A  lot  of  the  contracts  and  awards  for  sur¬ 
veys  are  not  developmental. 

Qitestion — Robert  Spirtas: 

I  would  just  like  to  make  a  few  points  that  argue 
against  the  position  that  Dr.  Juster  took  on  inflex¬ 
ibility  and  in  favor  of  what  Dr.  Hansen  proposed  on 
flexibility.  Since  situations  change  for  people  working 
within  the  Federal  agencies,  as  well  as  for  people 
working  within  a  contract  research  group,  there  are 
reasons  to  favor  Dr.  Hansen’s  position  of  allowing 
flexibility  within  the  contractual  process.  From  my 
position  within  Federal  agencies,  1  have  seen  changes 
in  constraints  after  a  contract  has  been  signed,  such  as 
travel  freezes,  which  inhibit  the  ability  of  the  agency 
employee  from  effectively  monitoring  the  contract.  If 
there  is  no  way  to  bring  in  the  contractor  to  see  the 
agency  project  officer  and  no  way  for  the  project  of¬ 
ficer  to  go  to  the  contractor’s  office,  there  may  be  a 
breakdown  in  communication.  There  may  also  be  a 
turnover  in  personnel  within  the  agency  and/or 
within  the  contractor’s  organization.  Often  such  turn¬ 
over  involves  persons  with  scientific  or  technical  ex¬ 
pertise  which  is  important  to  the  successful  monitor¬ 
ing  or  execution  of  the  contract.  There  may  also  be  a 
change  of  focus  mandated  by  Congress  or  by  some 
other  groups,  such  that  a  study  might  be  changed  af¬ 
ter  the  contract  has  been  signed.  Finally,  changes  in 
knowledge  take  place.  We  once  did  a  study  in  which 
we  had  to  change  our  unexposed  group  to  the  exposed 
group  because  of  a  change  in  knowledge.  Thus,  I 
would  argue  for  Dr.  Hansen’s  position  to  allow  as 
much  flexibility  as  possible  after  signing  of  a  contract. 

Tom  Juster: 

I  do  not  think  I  was  arguing  for  inflexibility.  What  1 
was  suggesting  simply  was  that,  if  you  have  unlimited 
flexibility,  the  bidding  process  in  the  competitive 
sense  does  not  mean  anything.  Because,  once  you 
have  flexibility,  renegotiation  is  possible  and  then  you 
no  longer  have  any  resemblance  to  a  competitive  bid.  I 


recognize  the  problem,  but  it  does  seem  to  me  that 
you  have  to  find  some  way  to  make  a  bid  mean 
something  like:  can  a  dollar  mean  a  dollar?  That  is,  if 
you  really  believe  in  competitive  bidding.  If  you  do  not 
believe  in  that,  that  is  fine.  I  really  don’t  believe  in  this 
process  but  the  rest  of  the  world  seems  to,  and  that  is 
the  way  the  procurement  process  is  shaped.  It  does 
not  work  the  way  it  is  supposed  to  work  right  now. 

Morris  Hansen: 

I  want  to  make  one  comment  on  Ted’s  comment 
about  the  Census  Bureau  versus  outside.  I  happen  to 
have  been  both  places  for  some  substantial  part  of  my 
life.  The  Census  Bureau  is  often  the  most  effective 
place  by  far  to  do  a  survey  Job  that  they  are  prepared 
to  take  on,  in  the  form  of  an  operating  Job,  if  you  can 
get  them  to  do  it.  But  they  may  not  be  able  to  fit  your 
time  schedule  and  their  time  schedule  together.  Also, 
they  tend  not  to  do  analytical  work  on  surveys  done 
for  others — they  provide  the  data  for  the  client  to 
analyze  and  interpret.  Also,  many  flexibilities  that 
private  organizations  have  are  not  available  to  govern¬ 
ment  organizations,  such  as  acquiring  equipment  and 
acquiring  personnel.  I  think  the  Federal  government 
ought  to  use  the  Census  Bureau  and  I  believe  it  does 
to  a  substantial  degree  where  it  is  applicable,  but  I  do 
not  think  it  is  quite  as  simple  as  separating  develop¬ 
mental  or  analytical  work.  I  think  that  the  Census 
Bureau  does  carry  out  developmental  and  analytical 
Jobs  effectively,  but  often,  because  of  other  priorities, 
it  cannot  handle  effectively  small  Jobs  that  may  be 
“developmental”  or  not,  and  do  them  on  a  reasonable 
time  schedule. 

Qiiestion — Ruth  Foster: 

There  should  be  some  way  to  check  on  the  track 
record  of  firms  contracted  to  perform  tasks  for  various 
agencies.  This  way,  the  firms  which  do  a  lousy  Job  in 
one  contract  are  not  awarded  another  contract  to 
avoid  the  same  mistake. 

Tom  Juster: 

Well,  you  know  there  are  two  notions  on  this.  I 
guess  I  have  the  feeling  that  not  much  account  is  taken 
of  how  people  have  performed  in  the  past.  There  is 
another  view  on  that.  If  you  take  the  view  that  takes 
the  legal  model,  you  do  not  allow  someone  who  is 
charged  with  a  crime  to  have  a  Jury  become  aware  of 
the  fact  that  that  person  has  been  convicted  or  ac¬ 
cused  of  15  past  crimes  or  has  not.  That  is  not  relevant 
legal  evidence.  The  presumption  is  Just  Judging  on 
this  basis.  I  suppose  that  people  might  argue  that 
evidence  of  malperformance  on  a  contract  is  and  may 
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not  really  be  valid  with  respect  to  what  a  person  or  an 
organization  promises  on  this  contract.  You  should 
not  hang  him  for  what  they  did  last  year.  On  the  other 
hand,  there  has  got  to  be  something  with  respect  to 
track  record  meaning  something.  Consistent  malper- 
formance  somehow  has  got  to  be  surfaced  as  a  rele¬ 
vant  variable  in  deciding  who  gets  the  contract.  I 
think  it  is  often  not  now  done,  not  because  people 
would  not  use  the  information  but  because  they  just 
do  not  know.  There  is  no  mechanism  and  the  reason 
there  is  no  mechanism  is  that  it  is  very  costly  to 
evaluate  the  outcome  of  an  RFP. 

Bob  Israel: 

It  is  more  than  costly  if  you  had  not  specified  very 
clearly  in  your  RFP  what  your  expectations  are. 
When  you  are  all  finished  and  you  look  at  the  results 
and  say:  Well,  they  did  not  measure  the  health  of  the 
people  over  65  in  the  United  States  very  well;  and  the 
contractor  says:  I  did  Just  what  you  asked  me  to  do  in 
the  RFP. 

Qitestion — Lee  Guilford: 

I  would  like  to  amplify  a  bit  on  the  comments  made 
by  the  previous  question.  I  think  one  of  the  problems 
is  that  the  government  is  not  in  its  present  system  able 
to  distinguish  between  Fast  Buck  Research  Company 


and  a  legitimate  outfit.  I  think  some  of  the  constraints 
the  contracts  office  puts  on  the  process  is  to  avoid  this 
kind  of  thing.  Perhaps  we  are  at  fault  in  not  giving 
them  some  guidelines  to  help  them  set  up  some  con¬ 
straints  that  will  help  them  and  us  to  distinguish  be¬ 
tween  the  good  guys  and  the  bad  guys.  I  think  that  is  a 
problem  we  have  to  face.  If  I  knew  how,  I  could  take 
over  the  meeting  and  you  would  have  no  function 
here. 

Tom  Jus  ter: 

Contracting  firms  have  something  called  bonding, 
don’t  they?  That  is,  you  cannot  bid  on  a  ten  million 
dollar  Job  if  your  capital  is  one  thousand  dollars. 
There  is  some  kind  of  a  classification  of  eligibility  and 
capacity.  Organizations  do  not  have  good  housekeep¬ 
ing  seals  of  approval,  saying  it  is  OK  for  you  to  bid; 
we  have  questions  about  it  unless  your  bid  has  certain 
characteristics.  I  guess  one  could  do  that. 

Lee  Guilford: 

There  is  a  related  problem  here  too.  That  is  that  not 
only  do  you  have  to  have  a  system  selecting  the  best 
firm  or  a  good  contract,  but  you  have  to  be  able  to  de¬ 
fend  that  this  is  a  good  process  and  you  might  have  to 
defend  it  in  a  court  of  law. 
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Confidentiality  of  Survey  Data — 
Panel  Discussion"^ 

Panel: 

Ida  C.  MERRIAM,  Moderator 
Robert  BORUCH,  University 

TOREDALENIUS,  Brown  Unwersity 
Joseph  W.  DUNCAN,  office  of  Federal  Statistical 
Policy  and  Standards,  U.S.  Department  of  Commerce 
Thomas  B.  J  ABINE,  Energy  Information  Administration, 
I  ’..S’.  Department  of  Energy 


Ida  Merriam: 

Privacy  and  confidentiality  of  information  about  in¬ 
dividuals  and  businesses  have  been  subjects  of  grow¬ 
ing  concern  over  the  past  5  or  10  years.  The  ASA  has 
paid  considerable  attention  to  the  problems  involved, 
particularly  as  they  affect  statisticians  and  the  Federal 
statistical  system.  In  March  1975,  the  president  of  the 
Association,  Lester  Frankel  appointed  an  Ad  Hoc 
Committee  on  Privacy  and  Confidentiality  to  review 
and  evaluate  the  statistical  implications  of  current 
legislative  and  other  proposals.  The  Committee 
developed  a  report — which  was  published  in  the 
American  Statistician  for  May,  1977 — that  laid  out  cer¬ 
tain  principles  and  discussed  their  implications. 
Basically,  the  report  emphasized  two  factors:  the  need 
to  find  a  balance  between  the  individuals’  right  to 
privacy  and  society’s  need  for  information — a  theme 
that  runs  through  all  current  discussions  of  the 
subject — and  the  fundamental  importance  of  the  dis¬ 
tinction  between  data  collected  for  administrative 
purposes  and  data  collected  solely  for  statistical  and 
research  purposes.  Most  of  you  are  probably  familiar 
with  the  report  of  the  Ad  Hoc  Committee.  It  is  worth 
rereading.  I'he  Ad  Hoc  Committee  was  followed  by  a 
continuing  ASA  Committee  on  Pirvacy  and  Confiden¬ 
tiality  which  is  attempting  to  monitor  current 
developments  and  make  sure  that  the  special  concerns 
of  the  statistical  profession  are  recognized. 

This  session  focuses  on  survey  data  and  will 
primarily  concern  itself  with  confidentiality  rather 
than  with  privacy.  The  two  concepts  are  interrelated, 
of  course,  and  survey  statisticians  must  pay  attention 
to  both.  But  they  are  not  the  same.  Privacy  relates  to 
the  individual’s  rights  to  be  left  alone  and  not  asked  to 
divulge  more  information  about  himself  than  is 
needed  or  is  justifiable.  Confidentiality,  on  the  other 
hand,  is  concerned  with  the  restrictions  placed  on  the 
use  and  dissemination  of  information  provided  on  sur¬ 
veys  or  otherwise.  We  are  going  to  assume  that  all  sur- 
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veys  any  person  of  this  audience  would  sponsor  or 
support  are  fully  justified  as  to  purpose  and  general 
approach,  and  give  our  main  attention  to  the  problem 
of  assuring  the  confidentiality  of  the  data  collected 
without  hindering  analysis  and  research.  First  we  will 
review  the  general  issues  involved  in  achieving  con¬ 
fidentiality  of  survey  data. 

Joseph  Duncan: 

W  hat  is  the  general  need  for  the  protection  of  sur¬ 
vey  data?  Why  are  we  so  concerned  about  it?  The 
need  is  very  simple.  It  is  essential  to  respondent 
cooperation  for  them  to  know  that  the  data  they 
provide  are  without  any  risk  to  themselves;  that  is,  it 
will  not  in  any  way  affect  their  own  future,  including 
their  rights,  benefits,  or  privileges  under  Federal  pro¬ 
grams  or  in  any  other  manner.  That  sounds  like  a 
fairly  simple  need,  yet  when  the  statistical  agencies’ 
activities  are  explored  today,  we  find  that  in  many 
cases  it  is  very  difficult  to  tell  the  respondent  that  the 
data  are  absolutely  restricted  and  highly  confidential. 

In  contrast  to  the  respondent’s  need  for  protection 
of  the  confidentiality  of  the  information  provided, 
there  is  a  statistical  and  sometimes  a  broad  govern¬ 
ment  need  for  access  to  individual  responses.  First  of 
all,  the  statisticians  would  like  to  review  the  individual 
survey  instruments  to  make  certain  that  the  data  files 
prepared  from  them  are  accurate  and  that  the  coding 
is  correct;  to  check  one  file  against  another  to  make 
sure  that  the  information  appears  reasonable;  and  a 
variety  of  other  file  enhancement  activities  that  are 
largely  statistical  in  character.  These  statistical  needs 
have  the  characteristic  that  there  is  a  sharing  of  the 
data  between  the  original  collector  and  somebody  else 
that  is  also  working  with  the  information.  Beyond  the 
statisticians  need  in  government  we  have  seen,  es¬ 
pecially  in  the  last  decade,  a  growing  need  by  the 
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regulatory  agencies,  or  at  least  a  perceived  need,  that 
they  too  should  have  access  to  statistical  information. 
Recently,  after  the  energy  crunch  and  latest  gas  lines, 
there  were  Congressional  hearings  saying  “Isn’t  it 
terrible  that  statistical  information  provided  is  not 
available  to  use  in  the  Congress  or  to  regulatory  agen¬ 
cies  so  we  can  check  up  on  the  oil  companies.”  This  is 
but  one  example.  Plus  there  is  a  need  generally  for 
avoiding  duplication  in  obtaining  information  that 
already  exists  elsewhere. 

So  this  leads  to  some  of  the  general  issues  that  we 
will  talk  about  today.  First  of  all,  how  do  you  provide 
clear,  legal  protection?  Second,  how  do  you  build  the 
public’s  confidence  so  that  they  will  feel  comfortable 
that  the  government  which  is  regulating  them  is  not 
using  the  statistical  information  gathered  from  these 
surveys  for  individual  cases. 

I'hird,  how  to  assure  that  statistical  agencies  can 
share  information  so  that  statistics  can  be  evolved 
with  a  minimum  of  burden  and  a  maximum  of 
accuracy. 

Ida  Merriam: 

Can  we  now  look  in  more  detail  at  the  need  for  legal 
protection  of  survey  records. 

Thomas  Jahine: 

To  understand  why  legal  protection  is  needed  for 
survey  records,  first  we  need  to  ask  what  is  being 
protected.  We  are  talking  of  records  from  statistical 
surveys,  that  is,  surveys  in  which  the  identification  of 
specific  individuals  is  not  material  to  the  final  results 
and  uses  that  will  be  made  of  the  survey  data.  Second, 
we  are  talking  only  about  records  that  are  individually 
identifiable,  either  because  there  are  particular  iden¬ 
tifiers  such  as  names  or  social  security  numbers 
associated  with  them,  or  because  the  detailed  content 
of  the  record  may  enable  people  with  outside  informa¬ 
tion  to  identify  particular  individuals.  If  the  records 
are  not  identifiable,  then  at  least  for  government- 
sponsored  surveys,  the  results,  including  micro¬ 
records  should  be  available  to  anyone  with  perhaps 
some  exceptions  for  security  reasons.  However,  there 
is  no  clear  dividing  line  between  those  records  that  are 
identifiable  and  those  that  are  not  identifiable.  This 
matter  is  currently  being  tested  in  the  courts  with 
respect  to  particular  data  sources.  We  can  talk  about 
either  public  or  privately-sponsored  surveys. 
However,  I  believe  that  legal  protection  for  survey 
data,  where  the  government  has  no  role  as  the  sponsor 
either  through  contract  or  grant,  is  an  unlikely 
prospect  in  the  near  future. 

424 


What  are  we  protecting  against?  We  are  protecting 
against  the  disclosure  of  identifiable  records  for  pur¬ 
poses  not  directly  related  to  the  survey.  There  may  be 
exceptions  to  this  but  the  possibility  of  their  occurrence 
should  be  well  understood  by  the  people  involved  in 
the  process — the  data  subjects  and  the  data  collectors. 
Disclosure  may  be  compulsory,  as  in  response  to 
Freedom  of  Information  requests,  subpoena  or  some 
other  legal  process.  It  may  be  inadvertent  through  in¬ 
adequate  physical  security  or  through  statistical  dis¬ 
closure  in  the  publication  of  results,  or  it  may  be 
voluntary  on  the  part  of  the  surveyor.  We  do  not 
necessarily  require  protection  against  all  types  of  dis¬ 
closure.  There  are  some  strong  arguments  that  are 
made  for  disclosure  for  statistical  purposes  not  direct¬ 
ly  related  to  the  initial  survey;  and  possibly  for  some 
other  purposes  such  as  disclosure  to  the  subjects  of  the 
data  for  their  own  use  or  for  reasons  of  health  and 
safety.  What  is  required  is  control  over  disclosures 
and  the  agreement  of  the  parties  involved. 

Why  do  we  say  that  legal  protection  is  needed? 
First  of  all,  why  is  any  protection  needed?  That  was 
covered  by  Joseph  Duncan;  the  reasons  are  equity  to 
the  survey  respondents  and  to  create  a  climate  in 
which  people  can  respond  to  surveys  and  not  feel  that 
the  data  will  be  used  to  affect  them  as  individuals 
directly.  There  is  a  question  of  equity  and  there  is  also 
a  question  of  not  undermining  the  ability  of  statistical 
agencies  to  collect  complete  and  accurate  data  to 
guide  public  policy.  There  is  some  fairly  good  ex¬ 
perimental  evidence  showing  that  inadequate  protec¬ 
tion  can  hurt  the  quality  of  response.  The  study  by 
Eleanor  Singer,  with  the  National  Opinion  Research 
Corporation,  shows  that  stronger  assurances  of  con¬ 
fidentiality  led  to  less  item  nonresponse.  Similarly,  the 
study  that  was  carried  out  by  the  Committee  on 
National  Statistics  with  the  support  of  the  Census 
Bureau  showed  that  the  level  of  confidentiality 
promised  to  respondents  had  a  small,  but  significant 
effect  on  response  rates.  There  is  a  lot  of  other  less 
direct  evidence  of  the  effect  of  inadequate  guarantees 
of  confidentiality.  Probably  business  respondents  are 
more  concerned  than  individuals  because  they  are 
more  aware  of  what  may  happen  to  the  information 
that  they  provide. 

Finally,  why  do  we  talk  about  legal  protection?  The 
actions  of  Federal  agencies  are  guided  by  statutes, 
regulations,  and  policies.  The  statutes  are  probably 
more  pertinent  than  regulations,  which  have  to  follow 
the  requirements  of  the  statutes,  and  the  regulations 
may  be  more  lasting  than  policies.  Ideally,  the  protec¬ 
tion  of  statistical  records  should  be  statutory  rather 
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than  merely  a  matter  of  policy  by  an  agency,  which 
can  be  fairly  easily  reversed.  Clearly,  the  present 
coverage  of  confidentiality  of  government  surveys  by 
statutes  is  deficient.  A  few  agencies  and  some  types  of 
surveys  have  strong  protection;  however,  a  price  often 
paid  is  that  the  access  of  others  to  data  from  those 
agencies  and  surveys  is  unnecessarily  restricted. 
Other  agencies  have  essentially  no  protection  in  their 
statutes  and  are  vulnerable  to  Freedom  of  Information 
requests  and  other  kinds  of  compulsory  disclosure. 
The  challenge  we  are  faced  with  is  to  provide  ade¬ 
quate  statutory  protection  without  placing  un¬ 
necessary  restrictions  on  the  use  of  survey  records. 

Ida  Merriam: 

Is  there  any  disagreement  in  this  panel  on  the  need 
for  moving  beyond  what  we  have  now  in  the  way  of 
statutory  protection? 

Tore  Dalenius: 

The  legal  community  has,  by  and  large,  been  most 
responsive  to  demands  for  legal  protection  of  our 
privacy.  It  may  be  argued  that  it  has  sometimes  re¬ 
acted  too  quickly  and  too  strongly.  I  would  welcome 
that  any  proposed  legislation  in  this  area  be  subjected 
to  a  thorough  “requirement  analysis”  in  close  co¬ 
operation  with  all  parties  involved.  When  legislation  is 
called  for,  the  merits  of  a  proposed  law  should  be 
assessed  with  respect  to  not  only  the  privacy  protec¬ 
tion  it  provides  but  also  its  impact  on  the  possibilities 
of  making  surveys  and  taking  censuses  in  an  efficient 
manner.  To  illuminate  the  importance  of  this  point,  I 
mention  the  legal  restrictions  concerning  the  use  of 
imputation  for  missing  data,  which  have  been  in¬ 
troduced  in  Sweden.  Legislation  must  not  be 
developed  in  isolation  from  the  needs  of  the  society  of 
information  on  which  to  base  its  program. 

Robert  Boruch: 

One  of  the  things  we  have  tried  to  do  recently  is  ex¬ 
amine  the  extent  to  which  cooperation  in  surveys  has 
been  influenced  notably  by  stronger  assurances  of 
privacy  and  confidentiality.  I  agree  with  Tom  Jabine’s 
remark  that  indeed  the  Census  Bureau’s  and  Singer’s 
studies  bear  out  the  need  for  strong  assurance.  It  is 
remarkable,  however,  that  so  many  people  in  these 
studies  choose  to  respond  without  much  in  the  way  of 
assurances.  Further  it  is  relatively  easy  to  find  smaller 
experiments  and  case  studies  in  which  people  respond 
irrespective  of  the  assurance  that  is  made,  they  ignore 
the  assurances  that  are  made  at  the  beginning  of  the 
interview.  The  point  here  is  that  an  argument  for 
stronger  protective  legislation  must  recognize  that 


there  are  a  subset  of  people  out  there  who  probably 
respond  to  a  questionnaire  written  in  crayon  and  on  a 
brown  paper  bag.  These  ought  to  be  recognized.  Just 
as  we  must  recognize  respondents  who  appreciate 
assurance. 

The  second  point  is  related.  If  we  look  over  the  10  or 
20  controversial  cases  in  which  it  has  been  announced 
that  privacy  has  been  a  major  factor  in  the  disruption 
of  a  survey  or  a  large-scale  program  evaluation,  we  see 
that  it  is  typical  that  the  privacy  issue  is  confounded 
almost  inextricably  with  a  number  of  other  issues. 
Those  other  issues  include  group  privacy.  For  exam¬ 
ple,  during  the  campus  protest  years,  the  Students  for 
a  Democratic  Society  objected  to  researchers’  studies 
of  campus  unrest ;  part  of  the  objection  concerned  in¬ 
dividual  privacy  while  a  larger  part  concerned  what  is 
now  considered  group  privacy.  Errors  in  reporting 
perceptions  are  chronic  both  in  newspapers  and  in 
magazines.  There  is,  for  instance,  a  nice  classical  case 
study  done  in  Norway  on  Project  Metropolitan’s 
large-scale  developmental  survey  of  adolescents  in 
which  some  disruption  was  apparently  caused  by 
public  confusion  over  the  distinction  between 
“sociological”  and  “socialist.”  In  any  case,  the  point 
is  that  there  are  other  issues  that  are  tangled  with 
privacy  matters  and  separation  of  the  issues  is  in  some 
cases  at  least  as  important  as  identifying  the  extent  to 
which  privacy  plays  a  role. 

My  third  point  is  a  question.  Tom,  you  alluded  to  a 
couple  of  court  cases  in  which  the  manner  of  iden- 
tifiability  of  data  was  an  issue.  Could  you  expand  on 
that? 

Thomas  Jabine: 

In  regard  to  your  first  point,  I  do  not  think  we 
should  take  too  much  comfort  from  the  fact  that  there 
is  a  large  body  of  the  population  which  seems  to  re¬ 
spond  to  almost  anything  without  too  many  objec¬ 
tions.  If  there  were  a  situation  in  which  it  were  found 
that  survey  data  were  being  used  for  a  non-statistical 
purpose  and  this  received  wide  publicity  then  many 
members  of  this  group  might  become  very  rapidly 
aware  of  what  was  happening.  This  could  be  a  real 
disaster  for  the  ability  to  do  a  census  or  anything  else 
that  depends  on  high  cooperation  rates. 

The  particular  case  that  I  had  in  mind  was  the 
Long  case.  Susan  and  Phillip  Long  are  two  tax 
scholars  who  have  been  doing  battle,  so  to  speak,  with 
the  Internal  Revenue  Service  over  a  number  of  years 
for  access  to  various  data  sets  that  IRS  maintains. 
Most  recently  they  have  requested  some  microdata 
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files  with  the  specific  identifiers  removed  from  the  IRS 
Taxpayer  Compliance  Measurement  Program.  This 
program  uses  a  probability  sample  of  taxpayers  and 
the  data  base  contains  the  detailed  data  from  their 
original  returns  as  well  as  the  results  of  the  audit  that 
are  performed  for  this  sample  of  cases.  The  most  re¬ 
cent  development  of  which  I  am  aware  occurred  in  the 
Appeals  Court.  The  District  Court  said  that  the  IRS 
was  not  required  to  make  this  information  available 
under  the  Freedom  of  Information  Act.  The  Appeals 
Court  reversed  this  ruling  saying  that  in  general  they 
would  have  to  release  the  records  unless  they  can 
show  that  there  is  some  significant  risk  of  individuals 
being  identified  by  indirect  methods  through  the  con¬ 
tent  of  the  data  files.  Now  the  District  Court  is  being 
asked  to  rule  on  the  question  of  whether  the  risk  of  dis¬ 
closure  of  individual  data  is  or  is  not  acceptable. 

Ida  Merriam: 

The  statutory  protection  of  the  statistical  system  to 
achieve  confidentiality  and  better  statistics  is  also  a 
protection  for  the  statistician  who  wishes  not  to  be 
forced  to  release  statistical  data. 

Robert  Boruch: 

I  am  not  sure  about  the  extent  of  that  problem  in 
our  own  situation.  At  Northwestern,  we  have  been 
engaged,  for  the  past  4  years,  in  secondary  analyses  of 
other  people’s  data,  where  data  were  generated 
originally  from  large  scale  social  program  evaluations. 
In  about  half  of  the  cases  where  we  meet  researcher 
resistance  to  giving  up  their  statistical  data,  it  is  not 
deliberate  and  malicious.  Rather,  resistance  is  due 
more  likely  to  incompetence  or  indifference  in  record 
keeping.  Some  people  resist  for  other  reasons,  such  as 
proprietary  interest:  they  would  like  to  exploit  the 
data  well  before  they  give  it  to  someone  else.  A 
minority,  if  any,  may  want  to  hide  something,  but  that 
is  very  difficult  to  verify.  We  have  not  pursued  cases  of 
the  sort. 

There  is  however,  an  important  recent  case,  Lora 
versus  the  Board  of  Education  of  the  City  of  .\eiv  York,  (74 
F.R.D.  565  (E.D.N.Y.  1977))  in  which  the  school 
system  decided  not  to  release  statistical  data.  That  is, 
it  decided  to  resist  disclosure  of  statistical  data  to  the 
Office  of  Civil  Rights  on  grounds  that  the  individual 
privacy  would  be  compromised.  They  attempted  to 
argue  that  releasing  such  data  affects  individual 
privacy,  not  in  order  to  impede  the  OCR’s  attempt  to 
establish  discrimination  in  the  school  system.  This 
sort  of  thing,  I  suspect,  will  be  more  likely;  it  certainly 
has  a  longer  history. 
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Joseph  Duncan: 

I  agree  that  I  would  like  to  protect  statisticians  but 
there  is  a  risk  in  tight  confidentiality  which  has  to  be 
addressed  in  the  legislation  that  is  drafted;  that  is,  you 
have  to  protect  the  public  by  assuring  that  the  statisti¬ 
cian  is  doing  a  good  job.  In  other  words,  there  needs 
to  be  an  opportunity  to  investigate  the  records,  audit 
the  way  in  which  the  statistician  made  his  estimates. 
-So  in  the  sense  that  you  create  very  strict  fortress-like 
regulations  you  may  eliminate  the  opportunity  for 
groups  like  the  Congress  to  audit  the  statisticians  in 
the  government. 

Tore  Dalenius: 

I  want  very  much  to  join  Dr.  Duncan  on  that  point. 
Let  me  also  emphasize  that  we  statisticians  have  a 
responsibility  to  our  profession  to  assess  critically 
allegations  about  disclosures  and  when  these  allega¬ 
tions  prove  to  be  false,  to  counteract.  As  an  example  of 
false  allegations,  it  has  been  claimed  by  a  prominent 
writer  on  privacy  issues  that  the  Census  Bureau  once 
disclosed  sensitive  information  about  identifiable 
physicians;  this  example  has  received  wide  publicity. 
It  appears,  however,  that  this  story  has  no  basis  in 
fact;  it  is  a  genuine  fabrication. 

Ida  Merriam: 

What  is  it  that  statisticians  themselves  have  been 
doing  to  make  sure  that  individual  information  is  not 
used  as  it  should  not  be? 

Tore  Dalenius: 

The  invasion  of  privacy  problem  has  long  been 
recognized  by  statisticians  and,  more  generally,  by 
social  scientists  and  the  like,  in  fact  long  before  the 
public  debates  in  the  1960s.  The  technological  devel¬ 
opment  in  the  recent  past  has,  of  course,  enlarged  the 
problems,  but  it  has  also  provided  more  powerful  tools 
for  coping  with  these  problems. 

In  the  setting  of  statistical  investigations  (surveys 
and  censuses),  it  is  clarifying  to  distinguish  three 
types  of  concern  about  invasion  of  privacy,  linked, 
respectively,  to:  (1)  the  substantive  focus;  (2)  the 
methods  used  for  data  collection,  processing  and 
storage;  and  (3)  the  consequences  of  releasing  the 
results. 

While  statisticians  pay  attention  to  all  three  types  of 
concern,  they  have — rightly,  I  think — paid  special  at¬ 
tention  to  the  two  last-mentioned  types.  I  will  give  a 
review  of  their  endeavors;  it  will  by  necessity  be 
limited  to  a  few  selected  examples. 
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With  respect  to  methods  for  data  collection, 
processing  and  storage,  statisticians  do  refrain  from 
using  methods  for  data  collection  (such  as  “partici¬ 
pant  observers”)  which  deprive  subjects  of  their  con¬ 
trol  of  self-presentation. 

When  it  comes  to  collection  of  “sensitive  informa¬ 
tion”,  statisticians  exercise  considerable  efforts  to 
reduce  the  possible  reluctance  of  the  subjects  to 
|)roviding  such  information.  In  a  survey  of  personal  in¬ 
come,  for  example,  it  is  a  long-established  practice  to 
collect  what  I  will  call  “interval  data”  rather  than 
“point  data”:  the  subject  is  asked  to  state  the  interval 
in  which  his/her  income  lies.  In  the  last  15  years, 
statisticians  have  in  addition  developed  new  methods 
for  collecting  “sensitive  information”  in  a  way  that 
gives  the  individual  subjects  protection.  Two  exam¬ 
ples  are  the  techniques  for  “randomized  response” 
and  “combined  questions.” 

By  the  same  token,  statisticians  carefully  protect 
the  data  collected  in  the  course  of  processing  and 
storage.  Thus,  elaborate  schemes  are  used  to  control 
access  to  the  facilities  where  the  processing  takes 
place,  and  likewise  to  the  computers  themselves  on 
which  the  processing  takes  place. 

If  the  data  are  not  destroyed  after  they  have  been 
processed,  schemes  for  data  protection  are  used.  Two 
examples  are  “file  splitting”  and  “encryption”. 

With  respect  to  the  consequences  of  releasing  the 
results,  methods  nowadays  known  as  methods  for 
“disclosure  control”  have  long  been  used  in  official 
statistics.  Clearly  the  development  of  new  media  for 
release  of  statistics  has  enhanced  the  problems.  The 
com|)uter,  for  example,  has  made  it  economically 
feasible  to  release  “micro-statistics”.  But  at  the  same 
time,  the  computer  is  a  key  instrument  in  im¬ 
plementing  schemes  for  disclosure  control;  using  such 
methods  as  “cell  suppression”  or  “privacy  transfor¬ 
mation”  is  an  integral  part  of  the  operations  which 
yield  the  results. 

In  summary,  statisticians  can  rightly  be  proud  of 
their  contributions  to  endeavors  to  strike  a  rational 
balance  between  society’s  need  to  know  and  citizens' 
right  to  privacy. 

Rnhert  Bornch: 

It  is  puzzling  that  legal  scholars  who  are  also  in¬ 
terested  in  statistics,  have  not  examined  randomized 
response  and  similar  strategies  for  protecting  data  to 
judge  the  extent  to  which  they  are  good,  bad,  or  indif¬ 
ferent  relative  to  legal  standards.  Based  on  some  of  the 


work  that  a  colleague  and  I  have  done,  it  does  seem 
clear  that  there  is  a  precedent  for  the  contention  that, 
in  some  courts,  probalistic  evidence  about  the  in¬ 
dividual  of  the  sort  produced  by  randomized 
responses  would  not  be  admissible  as  evidence.  In 
other  courts,  it  might  be  admitted  but  there  is  usually 
a  good  deal  of  controversy  over  it  and  so  would  be  of 
limited  probative  value.  In  any  case,  if  one  defines  in¬ 
vasion  of  privacy  or  identifiability  in  deterministic, 
rather  than  probalistic  terms  it  is  clear  that  the 
method  does  not  let  you  identify  anybody  or  attach 
meaning  to  the  response. 

Thomas  Jabine: 

The  question  of  how  safe  the  data  are  from 
statistical  disclosure  was  addressed  by  a  subcommit¬ 
tee  of  the  Federal  Committee  on  Statistical 
Methodology,  which  is  chaired  by  Maria  Gonzalez. 
The  subcommittee,  in  working  over  about  2  years  to 
produce  a  report  (number  2  in  the  OFSPS  Statistical 
Policy  Working  Paper  series),  found  some  instances 
where  they  felt  that  statistical  disclosure  had  oc¬ 
curred.  However,  in  spite  of  zealous  efforts,  including 
a  specific  request  that  was  published  in  the  Slalistiral 
Refmrter,  the  Subcommittee  was  not  able  to  come  up 
with  examples  where  individuals  felt  that  they  had 
been  harmed  as  the  result  of  any  statistical  disclosure. 

1  think  it  is  important  to  recognize  that  if  we  use  a 
broad  definition  of  statistical  disclosure  as  the  .Sub¬ 
committee  did,  some  disclosure  will  take  place  in  vir¬ 
tually  any  kind  of  release  of  aggregated  data  if  you 
know  which  individuals  are  members  of  the  popula¬ 
tion  on  which  the  data  are  based. 

I  would  like  to  get  back  to  one  thing  that  Tore  said 
about  not  using  participant  observers.  I  heard  of  a 
case  recently  which  would  probably  come  under  the 
heading  of  non-participant  observers.  The  Environ¬ 
mental  Protection  Agency  is  now  doing  some  surveys 
in  which  they  have  observers  at  retail  gas  stations. 
The  observers  know  which  pumps  are  being  used — 
leaded  or  unleaded;  they  record  the  license  numbers 
of  the  automobiles  and  then  by  checking  with  the 
Motor  Vehicle  Bureaus  they  can  find  out  what  kind  of 
cars  these  are  and  which  kind  of  gasoline  they  should 
be  using.  How  do  you  feel  about  that  kind  of  study? 

Ton-  Daleniits: 

I  will  give  a  specific  example.  .\  social  scientist  un¬ 
dertook  a  study  of  homosexuality.  .\s  a  means  of 
getting  a  sample  of  homosexual  men,  he  obserxed 
secretly  people  in  the  men’s  room  at  a  bar;  the 
behavior  there  of  some  men  indicated  that  they  were 
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homosexual.  When  they  left  by  car,  the  social  scientist 
recorded  the  license  plate  of  their  cars  and  was  thus 
able  to  get  the  names  and  addresses  of  the  drivers. 
.Authorities  on  ethics  in  research  with  human  beings 
would  no  doubt  consider  the  procedures  described  un¬ 
ethical;  I  fully  agree. 

Josef)h  Duncan: 

I  think  the  principle  I  started  with  in  the  beginning 
that  in  a  statistical  survey  the  data  of  the  respondent 
are  confidential  and  do  not  directly  infringe  on  his 
privilege,  has  been  violated;  I  doubt  that  he  has  been 
looking  at  it  as  a  statistical  survey  as  much  as  punish¬ 
ment  or  model  building  activity. 

Thomas  Jabine: 

.\s  I  understand  it  the  EPA  survey  was  purely 
statistical.  They  are  not  taking  any  action  against  the 
violators. 

Tore  Dalenius: 

The  problem  would  be  that  even  if  they  do 
something  which  is  not  a  statistical  survey  and 
generate  reactions  against  the  survey.  That  is  a  risk 
that  is  being  taken. 

Ida  Merriam: 

It  would  be  worth  reviewing  legislation  which 
provides  protection  against  release  of  data  files 
relating  to  specific  research  areas. 

Robert  Boriich: 

There  is  indeed  a  small  group  of  laws  that  provide  a 
researcher  with  some  protection  against  appropria¬ 
tion  of  information  on  identifiable  research  subjects. 
.\s  such,  these  laws  facilitate  the  researchers' 
adherence  to  ethical  standards,  and  to  the  extent  that 
research  participants  find  legal  protection  necessary, 
desirable,  or  attractive,  then  the  laws  may  also  help 
induce  people  to  cooperate  in  research.  Each  of  the 
statutes  focuses  on  a  different  area  of  research,  for  ex¬ 
ample,  mental  health,  criminal  justice,  and  others. 
Each  contains  slightly  different  provisions  affecting 
quality  and  level  of  protection. 

The  standards  used  to  gauge  quality  of  these  laws 
generally  include  matters  like:  whether  immunity  is 
automatic  rather  than  must  be  authorized  in  each 
case  or  for  each  project;  whether  immunity  refers  to 
administrative,  or  Judicial,  or  legislative  agencies  seek¬ 
ing  to  appropriate  the  data  or  the  individual  records; 
whether  all  information  or  Just  identifiers  is  covered 
by  the  statute,  and  whether  provisions  for  secondary 
analysis  are  included  in  the  statute.  My  description 
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here  is  brief,  adapted  from  a  more  thorough  treatment 
in  Boruch  and  Cecil  ( Assuring  Confidentiality  in  Social 
Research,  University  of  Pennsylvania  Press,  1979). 

First  among  these  is  the  Public  Health  Services  Act, 
which  entitles  the  Secretary  of  HEW  to  authorize  per¬ 
sons  engaged  in  research  on  mental  health,  including 
research  on  the  use  and  effect  of  alcohol  and  psycho¬ 
active  drugs,  to  protect  the  privacy  of  individuals  who 
are  subjects  of  the  research.  The  protection  is 
sustained  by  legally  mandating  the  researcher  to 
withhold  from  persons  not  connected  with  the 
research  the  names  or  other  identifying  characteristics 
of  such  individuals.  A  researcher  so  authorized  cannot 
be  compelled  in  any  Federal,  State  or  local  civil, 
criminal,  administrative,  legislative  or  other 
proceedings  to  identify  the  individuals.  The  Act  is  of 
considerable  importance  to  mental  health  researchers 
who  find  the  identity  of  respondents  can  be  protected 
legally;  moreover,  the  references  to  “other  identifying 
characteristics”  assures  that  the  researcher  can  at¬ 
tempt  to  prevent  deductive  disclosure  if  that  was  a 
problem.  The  protection  must  be  authorized  formally 
by  the  Secretary.  Consequently,  researchers  who  ini¬ 
tiate  politically  controversial  types  of  research,  such  as 
the  effects  of  marijuana  on  sexual  behavior  for  exam¬ 
ple,  are  at  risk  of  not  obtaining  the  grant  of  immunity 
or  having  it  rescinded.  There  is  no  provision  in  this 
.Act  for  disclosure  of  records  for  secondary  analysis. 

The  second  important  statute  is  the  Crime  Control 
.Act  of  1973  which  directs  attention  to  criminological 
research.  It  is  a  bit  more  complete  in  coverage  than 
the  Public  Health  Services  Act,  in  that  it  specifies  that 
information  contained  in  research  records  or  copies  of 
them  must  not  be  disclosed  by  the  researcher  to  any 
person  other  than  the  person  from  whom  it  was  col¬ 
lected.  The  use  of  identified  information  in  Judical  and 
administrative  proceedings  against  the  individual 
research  participant,  is  expressly  prohibited.  Unlike 
the  Public  Health  Services  Act,  this  law  provides  im¬ 
munity  to  all  information  not  Just  to  identifiers.  It 
does  not,  however,  prevent  legislative  committees 
from  appropriating  records  as  evidence. 

The  Controlled  Substances  Act,  the  third 
stereotypical  law  in  this  class,  authorizes  the  Attorney 
CJeneral  to  permit  persons  engaged  in  research  on 
controlled  substances  to  withhold  identification  of 
research  subjects  from  being  disclosed  in  legislative, 
administrative,  criminal  and  other  proceedings.  It  is 
an  important  statute  to  professionals  such  as  statisti¬ 
cians,  sociologists,  and  so  on  who  are  engaged  in  such 
research.  Like  the  Public  Health  Services  Act,  the 
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grant  of  immunity  depends  on  authorization  by  a 
Federal  agency  executive  and  as  such  it  is  subject  to 
the  same  problem — pressure  to  refuse  or  grant  the  de¬ 
mand  on  political  rather  than  scientific  grounds.  A 
related  law,  the  Drug  Abuse  Office  and  Treatment 
Act  protects  records  of  patients  maintained  in  connec¬ 
tion  with  drug  abuse  prevention  programs  assisted  by 
the  Federal  government  and  the  implementing  regula¬ 
tions  include  coverage  of  records  maintained  for 
research  purposes.  The  law  covers  material  other  than 
identification  of  the  subject,  and  moreover,  it  is 
automatic  rather  than  dependent  on  the  executive 
authorization.  The  immunity  is  limited  in  that  a  court 
may  in  fact  subpoena  the  identification  and  identified 
records. 

There  are  other  acts,  such  as  the  Health  Services 
Research  and  Medical  Libraries  Act  of  1974,  other 
special  legislation,  which  was  enacted  for  the  special 
studies  for  runaway  youth,  venereal  disease,  and  the 
like,  which  also  protect  data  of  certain  kinds.  The 
general  character  of  these  laws  is  such  that  the  level  of 
protection  is  mixed  and  interpretation  sometimes  gets 
very  difficult;  each  one  has  some  disadvantages  that 
another  one  may  not  have.  Partly  in  the  interest  of 
clarifying  the  matter  and  generating  broader,  more 
coherent  and  better  coverage  for  the  researcher  and 
the  respondent.  President  Carter  introduced  the 
Privacy  of  Research  Records  Act  in  April  1979  which 
is  among  the  pending  legislation  which  Joseph  Dun¬ 
can  and  Tom  Jabine  will  discuss. 

Jii.sfl)h  Duncan: 

.\s  Bob  just  mentioned,  in  April  there  was  a  bill  in¬ 
troduced  that  was  called  the  Privacy  of  Research 
Records  .Act;  but  there  has  been  no  action  on  this  bill 
thus  far;  there  have  been  no  hearings  and  there  are  no 
scheduled  hearings  to  date.  The  committee  is  tied  up 
with  legislation  affecting  Medical  Records,  which  is, 
of  course,  related  to  medical  research. 

Let  me  read  the  key  section  of  that  proposed  .Act 
that  sets  forth  the  principles;  it  says:  “Research 
records  collected  or  maintained  for  a  research  jHirpose 
or  collected  with  the  assurance  it  will  be  only  used  for 
research  purpose  by  an  agency  or  by  a  contractor  or 
grantee  of  an  agency,  shall  be  confidential,  shall  not 
be  used  in  whole  or  in  part  in  individually  identifiable 
form  to  make  any  decisions  or  to  take  any  action 
directly  affecting  the  individual  to  whom  the  records 
pertain.”  That  is  a  very  clear  statement  of  objectives 
and  goals  which  directly  relate  to  my  opening 
remarks.  The  bill  itself  is  then  filled  with  a  series  ofex- 
cejjtions  as  to  when  that  principle  w  ill  not  hold.  I  w  ill 
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just  touch  on  this  very  lightly  so  you  can  see  the  com¬ 
plexity  of  issues.  This  bill  provides  that  they  can  be 
disclosed  with  the  prior  written  consent  of  the  respon¬ 
dent.  It  can  also  be  disclosed  in  the  case  of  medical 
emergencies;  for  example,  disclosure  is  authorized  to 
deal  with  the  problem  when  something  is  found  out 
during  medical  investigations  that  need  to  be  dealt 
with  immediately  and  that  was  not  anticipated  in  the 
medical  case;  this  is  a  very  specialized  case. 

The  bill  does  specify  a  very  limited  set  of  situations 
in  which  the  judicial  proceedings  can  obtain  the 
record;  the  access  is  quite  restrictive  and,  in  my  judg¬ 
ment,  quite  satisfactory.  They  provide  an  exception 
that  deals  with  the  audit  of  the  research  itself;  the  case 
1  mentioned  a  little  earlier  in  our  discussion.  This 
provision  makes  it  possible  for  an  outsider  to  examine 
the  research  itself  to  verify  that  the  records  were 
|)roperly  maintained,  properly  interpreted  and  so 
forth.  This  way  we  could  verify  the  research  itself. 
Finally  there  are  exceptions  for  related  research  pur¬ 
poses,  an  exception  which  is  also  rather  carefully 
controlled. 

This  legislation,  like  the  next  piece  of  legislation  we 
will  talk  about — the  statistical  bill — has  been  drafted 
very  carefully.  The  lawyers  have  spent  a  lot  of  time 
worrying  about  obscure  details  and  implications. 
However,  as  the  bill  moves  through  the  legislative 
process  it  is  exposed  to  the  risk  that  something  w  ill  be 
added,  dropped,  or  replaced  with  something  else.  .So 
that  even  if  it  may  be  cleverly  drafted  at  the  outset, 
such  bills  merit  very  careful  attention  throughout  the 
entire  legislative  process. 

•A  second  piece  of  legislation  is  one  that  we  have 
been  talking  about  for  a  very  long  time.  It  is  called  the 
(lonfidentiality  of  Federal  .Statistical  Records.  It  has 
many  of  the  same  points  that  arc  in  the  Privacy  of 
Research  Records  Bill.  1  happen  to  feel  that  overall 
the  drafters  of  the  statistical  bill  did  a  little  better  job 
of  drafting.  The  bill  on  Federal  statistics  has  not  been 
introduced;  it  has  been  subject  to  agency  comment 
and  debate.  .My  own  personal  judgment  is  that  this  is 
an  excellent  bill  and  1  hope  it  sees  the  light  of  day. 

W  hat  the  proposed  statistical  bill  does  is,  first  of  all. 
to  establish  a  statutory  basis  for  the  traditional 
promise  of  confidentiality  which  has  long  been  given 
to  respondents  of  statistical  collection.  It  is  interesting 
to  me  that  many  of  the  sophisticated  participants  in 
the  statistical  system,  that  is,  the  outside  providers 
such  as  corporations,  have  assumed  that  when  they 
give  price  data  to  the  Bureau  of  Labor  .Statistics  they 
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are  protected.  It  is  true  that  they  are  protected 
because  BLS  has  an  unblemished  record  of  not  releas¬ 
ing  individual  records.  But  I  fear  that  under  a  legal 
test  there  might  be  some  trouble  because  there  is  no 
specific  piece  of  legislation  that  specifically  guarantees 
the  confidentiality  of  those  records.  Tradition  and 
practice  have  provided  a  sense  of  confidentiality;  what 
this  piece  of  legislation  does  is  put  it  into  statutory 
form  so  that  it  is  not  subject  to  somebody’s  whim  or 
policy  change  in  the  future. 

The  second  thing  this  bill  does,  which  I  think  is 
equally  important  and  is  of  particularly  great  interest 
to  the  statistician,  is  it  provides  for  a  limited  sharing  of 
individually  identifiable  records  for  statistical  pur¬ 
poses  within  the  statistical  system.  Once  the  statutory 
protection  has  been  given  to  an  agency,  these 
statistical  records  cannot  be  used  in  an  individually 
identifiable  form.  They  can,  however,  be  traded 
among  covered  statistical  agencies  for  purposes  of 
enhancing  the  data  file  or  verifying  individual  records 
so  that  statistical  information  will  be  improved. 

The  protected  statistical  centers  that  are  named  in 
the  legislation  at  the  moment  include  the  Bureau  of 
the  Census,  the  Bureau  of  Economic  Analysis,  the 
Bureau  of  Labor  Statistics,  the  Economics,  Statistics, 
and  Cooperatives  Service  of  the  USDA,  the  Office  of 
Research  and  Statistics  in  the  Social  Security  Ad¬ 
ministration  of  HEW,  and  the  Division  of  Science 
Resources  Studies  of  the  National  Science  Founda¬ 
tion.  This  would  be  the  initial  set.  There  is  a  provision 
that  additional  agencies  would  become  certified  if 
they  will  follow  certain  practices.  For  example,  right 
now  the  legislation  under  which  the  Energy  Informa¬ 
tion  Administration  operates  has  a  mixing  of 
regulatory  and  statistical  purposes.  That  would  not  be 
compatible  with  this  bill,  but  the  energy  bill  could  be 
amended.  An  enclave  could  be  created  within  the 
Department  of  Energy  that  would  then  participate  in 
this  whole  system.  It  also  provides  for  the  establish¬ 
ment  of  protected  statistical  files,  that  is  statistical 
files  not  held  by  these  major  agencies  could  be  cer¬ 
tified  so  that  they  would  be  confidential  and  protected 
as  well  by  action  of  the  Central  Statistical  Office. 

There  are  a  series  of  sanctions  in  the  system.  There 
are  penalties  if  people  violate  this  statute  and  there  is 
a  provision  for  controlling  the  exchanges  among 
statistical  agencies  so  that  it  is  not  a  willy-nilly  thing 
without  need  and  without  justification. 

If  both  of  these  bills  were  enacted,  in  the  forms  in 
which  they  presently  exist,  many  of  the  problems  of 
the  day-to-day  use  of  statistical  and  research  data 
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would  be,  in  fact,  resolved.  There  is  still  a  lot  of  effort 
that  has  to  take  place.  For  example,  a  major  job  of 
public  education  is  required.  Many  people  have  a  dis¬ 
trust  of  government.  They  believe  that  any  data  that 
they  give  may  be  used  against  them.  It  is  going  to  take 
a  long  time  before  this  feeling  is  offset.  These  bills  do 
provide  a  rather  clear  basis  to  set  aside  statistical  data 
collection  and  research  data  collection  as  highly  pro¬ 
tected,  highly  confidential  pieces  of  information  about 
individuals. 

Ida  Merriam: 

What  about  the  capability  of  differentiating  be¬ 
tween  statistical  files  and  other  files  with  statistical 
information? 

Thomas  Jabine: 

The  two  bills  that  have  been  described  take  slightly 
different  approaches  to  this.  In  the  Privacy  of 
Research  Records  Bill,  there  is  a  definition  of  research 
records.  Then,  it  is  up  to  each  of  the  agencies,  in  ad¬ 
vance  of  creating  new  records,  to  determine  whether 
or  not  these  are  going  to  be  research  records  and  to 
treat  them  accordingly.  In  the  case  of  the  Confiden¬ 
tiality  of  Federal  Statistical  Records  Bill,  this  is  done 
primarily,  although  not  entirely,  by  designating 
separate  agencies  or  parts  of  agencies  that  are  clearly 
identifiable  as  protected  statistical  centers.  One  of  the 
principles  is  that  any  records  that  those  agencies 
maintain,,  except  for  internal  administrative  records, 
must  be  treated  as  statistical  records  under  this 
legislation.  So  those  are  two  different  approaches;  but 
I  would  like  to  say  that  there  was  full  coordination 
between  the  people  who  worked  on  these  two  bills, 
and  they  are  intended  to  complement  each  other.  The 
statistical  records  bill  does  certain  things  that  the 
research  records  bill  does  not.  First  of  all,  it  covers  in¬ 
dividual  and  business  records,  whereas  the  research 
records  bill  covers  only  records  about  individuals. 
Second,  it  set  up  separate  units,  the  protected  centers, 
that  can  maintain  only  statistical  records.  It  is  a  com¬ 
plex  bill,  but  what  it  does  was  summed  up  very  well 
by  Dorothy  Rice  as  discussant  in  a  session  this  morn¬ 
ing,  namely,  that  the  things  that  would  be  accom¬ 
plished  by  this  bill  in  terms  of  protection  and  sharing 
of  information  within  the  enclaves  are  things  that 
would  happen  fairly  naturally  if  this  country  had  a 
centralized  statistical  system  instead  of  a  decen¬ 
tralized  one.  This  bill  offers  a  way  of  getting  some  of 
the  benefits  of  centralization  without  losing  the  signifi¬ 
cant  advantages  that  we  get  from  decentralization, 
with  the  statistical  units  being  close  to  their  primary 
users. 
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Robert  Boruch: 

One  peculiar  aspect  about  the  coverage  of  these 
laws  has  to  do  with  the  separation  of  education 
statistics  from  all  other  statistics;  by  education 
statistics  here  I  mean  also  evaluation  of  Title  I 
programs,  surveys,  and  the  like.  1  notice  that  no  one  in 
the  President’s  Reorganization  Project  is  from  NCES. 
\’et,  a  lot  of  relatively  innocuous  education  statistics 
are  collected,  they  sometimes  generate  privacy  con¬ 
cerns,  and  they  certainly  are  extensive  enough  to 
Justify  a  place  in  Federal  statistical  systems  theory. 

Josef>h  Duncan: 

I  will  state  one  problem  for  you.  The  National  Cen¬ 
ter  for  Education  Statistics  collects  records  from 
public  schools,  elementary  and  secondary  schools. 
That  information  under  this  bill  would  then  become 
protected  and  individual  records  could  not  be 
revealed.  Part  of  NCES’s  role  is  to  publish  informa¬ 
tion  about  individual  institutions.  This  presents  a  con¬ 
flict  since  the  intent  of  this  proposed  bill  would  be  to 
protect  the  information  of  individually  identified 
institutions. 

Thomas  Jahine: 

Your  explanation  is  correct.  The  National  Center 
for  Education  Statistics  was  consulted  in  the  process 
of  determining  which  agencies  should  be  named  as 
protected  centers.  It  was  clear  that  it  was  not  ap- 
propriate  for  those  reasons.  However,  there  does 
remain  the  possibility  that  files  from  some  of  their  sur¬ 
veys  which  deal  with  individuals  rather  than  with  in¬ 
stitutions  could  attain  the  status  of  protected  files. 

Joscfih  Duncan: 

There  is  the  possibility  that  one  should  create  a 
subunit  that  is  the  protected  statistical  center  and 
have  another  unit,  for  example,  that  handles  the  other 
ty|)es  of  information.  The  other  possibility  for  this  bill 
is  to  create  protected  files  which  are  protected  under 
the  legislation. 

One  of  the  interesting  things  that  the  bill  tries  to  do 
is  to  say  that  there  is  a  lot  of  administrative  informa¬ 
tion  which  the  government  collects  which  has  a  value 
for  statistical  analysis  and  for  statistical  purposes. 
This,  in  effect  creates  a  one  way  flow  process  where 
data  collected,  let  us  say  for  regulatory  purposes, 
flows  into  the  statistical  agency  and  is  then  enhanced 
within  the  statistical  agency’s  data  base.  That  is  good 
for  the  statistical  agency.  Further,  it  is  protected  once 
it  is  inside  the  statistical  agency.  If  somebody  wants  to 
access  the  regulatory  information  they  have  to  go  back 
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to  the  original  part  of  the  department  that  collected 
the  information.  They  cannot  have  access  to  the 
enhanced  information  which  may  include  information 
beyond  what  was  submitted  from  the  regulatory 
agency. 

Robert  Boruch: 

I  would  like  to  ask  a  question  about  both  of  the  acts. 
One  of  the  interesting  features  of  the  Medical  Records 
Act,  another  bill  submitted  by  Carter,  which  does  not 
stand  out  in  the  research  act  or  the  statistics  act,  con¬ 
cerns  those  people  who  fraudulently  represent  them¬ 
selves  as  physicians  seeking  medical  records.  Under 
the  Medical  Records  Act,  such  people  could  be 
prosecuted  for  their  deception.  In  our  case,  counterfeit 
researchers  in  market  research  are  not  unknown;  Bax¬ 
ter,  for  instance,  has  written  a  couple  of  nice  articles 
about  salesman  claiming  to  be  pollsters.  Is  there  any 
provision  for  impeding  the  counterfeit  researcher  in 
the  new  proposed  laws? 

Thomas  Jahine: 

No,  I  do  not  know  of  any  such  provision.  Both  of 
these  bills  deal  only  with  records  that  are  maintained 
by  or  under  the  sponsorship  of  the  Federal  agencies 
and  all  the  penalties  relate  to  improper  disclosure  by 
the  holders  of  the  records. 

QL  KS  I  lO.VS  FRO.M  I  HK  .M  DIK.NCF. 

(htestion — .-1  ryness  1 1  ickens: 

I  would  like  to  ask  an  operational  question  of  Joe 
Duncan.  You  have  been  discussing  this  confidentiality 
situation  for  2  years  and  a  very  considerable  number 
of  points  have  been  raised.  What  is  the  present  status 
of  the  legislation  required  to  assure  that  the  statistical 
enclaves  were  adequate  for  their  purposes?  Where  do 
we  stand  in  all  of  this?  What  apparatus  would  make 
this  legislation,  which  we  have  been  discussing  for  the 
past  several  years,  work? 

Josefih  Duncan: 

When  this  session  of  the  ASA  was  planned,  it  was 
anticipated  that  the  President’s  Reorganization  Proj¬ 
ect  study  entitled  the  Statistical  System  Project 
would  have  been  complete.  There  would  be  proposals 
both  on  the  Hill  or  at  least  for  the  public  and  one 
thing  we  would  do  at  this  meeting  of  the  ASA  is 
discuss  and  debate  the  details  of  what  has  been 
|)roposed.  In  the  case  of  the  legislation,  the  draft 
legislation  has  gone  through  a  process  of  interagency 
clearance  and  review  which  means  there  is  a  con¬ 
census  that  this  is  an  appropriate  position  for  the  Ad¬ 
ministration  to  take.  However,  the  final  step  in  that 
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process  once  it  has  cleared  the  agencies  is  to  clear  the 
Office  of  Management  and  Budget  and  the  White 
House  and  become  part  of  the  President’s  legislative 
package.  This  has  not  yet  happened,  although  we  an¬ 
ticipate  that,  if  there  is  an  action  on  the  Statistical 
System  Project  overall,  the  legislation  will  be  part  of 
that  action.  In  fact,  the  legislation  was  basically 
available  at  the  same  time  that  the  Research  Records 
Act  was  available  in  April,  and  it  was  withheld  partly 
because  it  was  tied  together  with  the  Reorganization 
Project. 

Now  on  statistical  reorganization  itself,  the  hope  is 
that  within  a  very  few  weeks,  there  will  be  a  decision 
in  the  White  House  about  the  future  organization  of 
Federal  statistical  activities.  The  Statistical  System 
Project  basically  focuses  on  one  question:  “How  can 
we  have  stronger  planning  and  coordination  of  the 
decentralized  system?”  It  is  not  a  study  of  whether  the 
Census  Bureau  and  BLS  should  be  combined.  The 
fundamental  question  of  how  should  the  statistical 
system  be  strengthened  for  planning  and  coordination 
has  not  been  controversial.  The  issue  has  been  where 
should  the  resources  for  planning  and  coordination 
come  from  and  where  should  they  be  located 
organizationally  ? 

When  the  mechanism  for  stronger  planning  and 
coordination  is  in  place,  there  will  be  no  problem  with 
the  operational  dimension  of  this  bill  because  it  says 
that  the  Chief  Statistician  will  make  the  determina¬ 
tions  necessary  as  to  what  agencies  are  enclaves  and 
what  exchanges  occur  among  agencies.  In  the  absence 
of  a  strengthening  of  planning  and  coordination  func¬ 
tions,  it  would  fall  back  on  my  Office,  and  I  would 
have  to  say  that  we  have  relatively  limited  resources  to 
deal  with  the  problem  presently.  It  is  not  a  major  task 
in  the  limited  sense  that  it  is  proposed  here.  At  the 
start,  it  should  be  fairly  easy  to  administer.  It  is  the  ex¬ 
pansion  of  the  protection  to  other  data  files  and  the  es¬ 
tablishment  of  new  protected  centers  that  would  re¬ 
quire  more  resources. 

Question — Michael  Lampkier: 

This  discussion  has  concerned  itself  principally  on 
the  matter  of  individual  records — protection  of  in¬ 
dividual  personal  confidentiality.  Professor  Boruch 
noted  in  passing  that  there  has  been  some  resistance 
to  response  by  those  who  want  to  maintain  group 
privacy.  Is  there  any  development  in  terms  of  the 
protection  of  any  collective  rights?  Has  this  issue 
arisen  for  any  official  consideration  in  deliberations  on 
the  protection  of  statistical  files  where  there  might  be 
the  possibility  of  exposure  of  vulnerable  minorities 
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whether  we  are  talking  about  ethnic  minorities  or 
those  of  socioeconomic  status,  or  whatever? 

Joseph  Duncan: 

I  will  give  you  a  tangential  reply.  In  the  discussion 
of  this  proposed  legislation,  the  answer  is  “no”  direct¬ 
ly,  because  the  purpose  of  this  legislation  is  to  make  it 
feasible  for  the  individual  records  to  be  published  very 
broadly  in  aggregates  and  all  aggregates  are  sub¬ 
classes  of  one  sort  or  another.  People  in  a  subclass 
might  suffer  because  a  piece  of  legislation  affects  the 
subclass.  These  bills  do  not  deal  with  that  aspect,  but 
there  is  still  the  philosophical  question:  What  should 
you  do  about  subclasses?  The  related  development  is 
that  as  a  result  of  growing  intentions  of  various 
minorities  populations,  which  are  defined  quite 
broadly  since  women  are  a  minority  under  current 
definitions  (even  though  they  are  a  majority  to  statisti¬ 
cians),  the  pressure  has  been  quite  the  reverse.  This  is, 
there  is  pressure  for  more  data  about  minorities, 
defined  various  ways,  so  that  newly  defined  minorities 
can  get  their  rights  along  with  the  other  minorities. 
What  we  have  seen  to  date  is  concern  by  the 
minorities  that  they  are  going  to  have  their  rights 
violated  in  some  way;  and,  therefore,  they  want  to 
make  sure  that  there  is  more  information.  That  puts  a 
tremendous  demand  on  the  statistical  system,  because 
the  more  subclasses  that  you  want  to  try  to  define 
statistically,  the  larger  your  sample,  the  greater  the 
tabulations  costs  and  so  forth. 

Thomas  Jabine: 

This  is  an  historical  comment  on  the  questions.  The 
predecessor  of  the  present  ASA  Committee  on  Privacy 
and  Confidentiality,  the  Ad  Hoc  Committee,  did 
discuss  this  issue  at  length.  I  think  the  final  conclusion 
was  that  we  would  not  make  any  recommendations  in 
that  area.  I  think  our  feeling  was  that  depending  on 
what  particular  classification  of  individuals  you  were 
using,  we  are  all  members  of  minorities  of  one  kind  or 
another;  if  you  try  to  place  restrictions  on  data  that  af¬ 
fect  particular  population  subgroups,  you  just  have  an 
intractable  problem. 

Robert  Boruch: 

I  agree  that  the  problem  is  terribly  complicated  and 
one  ought  to  examine  it.  It  does  seem  to  be  an  old 
problem  in  the  sense  that  early  epidemiological  sur¬ 
veys  in  New  York  during  the  late  1700’s  and  early 
1800’s  encountered  a  great  deal  of  resistance  from,  for 
example,  the  Irish  immigrants  because  they  figured 
the  government  was  out  to  get  them  or  that  govern¬ 
ment  would  change  immigration  laws  in  a  way  which 

Statistical  Reporter 


was  not  in  their  interest.  Certainly  the  problem  affects 
other  cultures.  Britain,  for  example,  with  its  popula¬ 
tion  of  Caribbeans,  Indians,  and  the  like,  has  given 
some  time  to  exploring  the  notion  of  group  privacy,  a 
social  ethic,  if  you  will.  It  is  a  pervasive  problem,  but 
perhaps  it  ought  not  be  prematurely  incorporated  in 
such  things  as  these  laws.  We  know  too  little  about  the 
matter  to  do  so,  and  the  laws  are  complicated  as  it  is. 
It  does  seem  to  me  there  is  a  real  political  imbalance 
here;  all  the  sophistication  is  on  the  side  of  data 
gatherers  rather  than  on  the  side  of  the  individual  who 
provide  the  information.  This  possible  inequity  is  a 
chronic  and  pervasive  problem,  it  does  seem  to  be  a 
legitimate  intellectual  problem,  it  does  deserve  serious 
intellectual  attention  even  if  it  cannot  be  tackled  un¬ 
der  the  rubric  of  what  we  are  talking  about  here. 

(Question: 

1  would  like  to  ask  a  hypothetical  question.  A  cer¬ 
tain  Federal  agency  lets  a  contract  with  a  private  sur¬ 
vey  company  and  in  order  to  check  up  on  the  com¬ 
pany’s  work  asks  it  to  supply  a  list  of  the  respondents 
in  the  survey;  the  Federal  agency  proposes  to  call  the 
respondent  and  ask  them  if  they  have  been  contacted. 
What  is  the  privacy  and  confidentiality  aspects  of 
this?  Is  it  legitimate  or  are  there  problems  with  it? 

Thomas  Jabine: 

This  sort  of  thing  does  happen,  not  only  in  govern¬ 
ment  surveys  but  in  private  surveys  for  market 
research  and  other  purposes.  Very  often  when  the  sur¬ 
veyor  explains  to  the  respondent  what  is  going  to  hap¬ 
pen,  the  surveyor  will  say  my  supervisor  may  call  you 
in  a  day  or  two  just  to  find  out  if  I  have  been  here.  1 
think  that  is  in  keeping  with  the  notification  principles 
that  are  generally  accepted  as  desirable  in  surveys, 
i.e.,  that  you  tell  people  what  will  be  the  consequences 
of  agreeing  to  take  part  in  the  survey. 

Robert  Boruch: 

There  is  some  evidence  which  may  be  helpful  here. 
It  concerns  the  U.S.  General  Accounting  Office's  in¬ 
terest  in  reinterviewing  participants  in  the  Ex¬ 
perimental  Housing  Allowance  Program  (EHAP).  As 
you  may  know,  EHAP  was  run  by  Abt  Associates  and 
Rand,  under  contract  with  the  Department  of  Hous¬ 
ing  and  Urban  Development.  These  agencies  resisted 
G.XO’s  request  for  a  list  of  participants  and  for  data, 
under  the  argument  that  participants  were  assured  of 


confidentiality.  GAO  persisted  under  the  argument 
that  (iAO  is  mandated  to  oversee  quality  of  such 
research  under  current  law.  The  resolution  was  to 
have  the  original  investigators  elicit  from  participants’ 
written  consent  to  be  reinterviewed  by  GAO.  For  the 
three  experimental  sites,  65-85%  of  participants  gave 
permission  and  were  reinterviewed.  This  cooperation 
rate  evidently  did  not  satisfy  GAO;  frankly  Tm  sur¬ 
prised  that  cooperation  rate  was  so  high.  Other  tactics 
for  reconciling  conflicting  interests  in  this  context  are 
reported  in  a  monograph  produced  by  the  Social 
Science  Research  Council’s  Committee  on  Program 
Evaluation,  and  in  the  monograph  by  Boruch  and 
Cecil  cited  earlier. 

Josel>h  Duncan: 

Let  me  Just  make  two  quick  comments.  First  of  all, 
the  legislation  I  described  does  have  a  provision  in  it 
explicitly  for  performing  an  audit  of  individual 
records.  Let  me  give  you  another  brainteaser.  In  the 
collection  of  price  data,  one  of  the  issues  is  how  do  you 
develop  a  sampling  frame.  The  BLS  has  developed 
relationships  with  several  associations  representing 
different  industries,  hospitals,  universities,  and  so 
forth,  to  help  collect  data.  One  of  the  industries 
became  unhappy  with  the  numbers  in  the  Consumer 
Price  Index  affecting  their  industry.  So  under  the 
Freedom  of  Information  Act  they  filed  for  a  list  of  the 
samples  that  were  used.  (Incidentally,  it  was  drawn 
from  a  complete  industry  list  they  had  provided.)  My 
Office  took  the  position  that  they  could  not  have  it, 
that  this  was  statistical  information  that  was  confiden¬ 
tial.  The  reasoning  was  really  quite  simple;  if  we 
made  a  practice  of  giving  nut  sample  list  on  every  sur¬ 
vey,  we  would  certainly  increase  reporting  and  harass¬ 
ment  and  people  would  stop  filling  out  forms  for 
anyone.  But  in  the  individual  case,  this  is  not  terribly 
unlike  the  audit  which  we  are  speaking  of  because  in 
effect  this  association  wanted  to  audit  their  own  mem¬ 
bers.  It  becomes  a  little  of  a  brainteaser  in  that  it 
demonstrates  the  difficulties  one  gets  into  when  you 
push  these  things  to  the  limits. 

Ida  Merriam: 

One  point  that  might  be  worth  repeating  is  that  the 
research  bill  applies  only  to  individuals,  whereas  the 
statistics  bill  covers  also  corporations  and  other  legal 
entities. 
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CURRENT  DEVELOPMENTS 


EMPLOYMENT  COST  INDEX  EXPANDED 

The  Bureau  of  Labor  Statistics’  Employment  Cost 
Index  now  includes  measures  of  quarterly  change  in 
compensation,  wages,  and  benefits.  Beginning  with 
the  March  1980  quarter,  compensation  change  data 
became  available  for  the  total  private  nonfarm  sector. 
.Additional  series  are  given  for  white-collar,  blue- 
collar,  and  service  workers,  and  the  manufacturing 
and  nonmanufacturing  industries. 

The  wage  component  of  the  Employment  Cost  In¬ 
dex  is  defined  as  straight-time  average  hourly  earn¬ 
ings.  In  addition  to  wages,  the  expanded  index  in¬ 
cludes  23  employee  benefits — standard  benefits  (such 
as  vacations,  pensions,  life  insurance)  and  legally  re¬ 
quired  benefits  (such  as  social  security).  The  cost  of 
benefits  to  the  employer  is  expressed  as  cost-per-hour 
worked. 

I'o  be  placed  on  the  mailing  list  to  receive  future 
releases  of  the  Employment  Cost  Index,  contact  the 
Bureau  of  Labor  Statistics,  Office  of  Publications,  441 
C  Street,  N.W.,  Washington  D.C.  20212,  telephone 
(202)  523-1221.  (BEI’H  LEVIN,  BUREAU  OF  LABOR 
s  i'.vns  rics,  debar  iment  of  labor,  telephone  (202) 
523-1165) 

FALL  ENROLLMENT  IN 
HIGHER  EDUCATION  1978  and  1979 

Each  fall  the  National  Center  for  Education  Statis¬ 
tics  conducts  a  survey  of  the  number  of  students  en¬ 
rolled  in  U.S.  colleges  and  universities  as  part  of 
NCES’  Higher  Education  General  Information  Sur¬ 
vey  (HEGIS)  program.  Fall  Enrollment  is  the  only 
complete  institutional  count  of  all  students  enrolled  in 
colleges  and  universities  during  the  fall  of  each  year. 
The  report  for  the  1978-79  academic  year,  now 
available  in  hard  copy,  also  includes  race/ethnicity 
data  which  may  now  be  compared  with  the  1976 
enrollment  report  published  by  NCES. 

Some  highlights  of  the  1978  report  are: 

•  Enrollment  in  the  Nation’s  colleges  and  uni- 
434 


versities  declined  for  the  seconcTtime  in  the  last  3 
years,  dropping  to  about  11,391,000. 

•  Public  college  and  university  enrollment 
dropped  for  all  three  types  of  institutions  (uni¬ 
versities — 0.4  percent,  other  4-year — 0.9  percent, 
and  2-year — 0.8  percent). 

•  In  contrast,  total  private  school  enrollment  in¬ 
creased  1.6  percent. 

•  .A  decrease  in  the  enrollment  of  men  was  partly 
offset  by  an  increase  in  the  enrollment  of  women. 

The  tables  presenting  the  1978  data  are  grouped 
under  seven  major  categories:  summary  tables,  and 
enrollments  by:  level  of  institution.  State,  individual 
institution,  race/ethnicity,  major  degree  field,  and 
major  degree  field  and  race/ethnicity.  Copies  of  the 
printed  report,  entitled  Fall  Enrollment  in  Higher  Educa¬ 
tion  1978,  NCES  79-317,  GPO  Stock  Number  065-000- 
0000-5-9,  may  be  purchased  at  the  price  of  $6.50  from 
the  Superintendent  of  Documents,  U.S.  Government 
Printing  Office,  Washington,  D.C.  20402. 

Data  users  may  also  purchase  the  data  tapes  that 
contain  all  of  the  data  collected  in  the  1978  and  1979 
surveys.  Researchers,  businesses,  colleges,  and 
associations  can  use  the  tape  to  generate  their  own 
tables  and  conduct  special  analyses  of  the  enrollment 
data.  In  addition,  performatted  tables  are  available  in 
two  forms — printout  and  microfiche — which  are 
described  further  in  footnotes  to  the  published  tables. 
NCE.S  also  has  the  capability  to  perform  special 
tabulations  prepared  according  to  user  specifications. 
.Additional  information  about  the  computer  tape  and 
related  products  can  be  obtained  from  the  Data 
Systems  Branch,  NCES  (1001  Presidential  Building), 
400  Maryland  Avenue,  S.W.,  Washington,  D.C. 
20202,  telephone  (301)  436-7944. 

Further  information  on  the  surveys  and  the  printed 
report  may  be  obtained  from  the  author,  Andrew  J. 
Pepin,  telephone  (301)  436-6425.  (O.  JE.AN  BraNDE.S. 
N.\  I  l()\.\L  C:E.\  I  ER  for  EDUC:.Vn()N  .SI  vn.S  I  IC'.S.  DE- 
P.\RI.\IE\r  OF  EDUCATION,  telephone  (301)  436- 
7873) 
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REPORT  ON  ENVIRONMENTAL 
HEALTH  DATA 

Citing  deficiencies  of  data  on  the  effects  of  human 
exposure  to  environmental  hazards,  the  Department 
of  Health  and  Human  Services  has  sent  to  Congress 
recommendations  to  improve  the  collection  of  en¬ 
vironmental  health  data  and  to  coordinate  Federal  en¬ 
vironmental  health  activities. 

Environmental  Health:  A  Plan  for  Collecting  and  Coor¬ 
dinating  Statistical  and  Epidemiologic  Data  reviews 
Federal  data  systems  that  gather  information  on 
health  and  the  environment  and  identifies  gaps  and 
deficiencies  in  data. 

The  report  was  requested  by  Congress  in  Public 
Law  95-623  and  was  prepared  by  HHS’s  National 
Center  for  Health  Statistics. 

Based  on  information  supplied  by  18  Federal  agen¬ 
cies,  the  report  identifies  and  describes  64  data  collec¬ 
tion  systems  that  may  be  useful  for  research  and 
epidemiologic  studies  in  environmental  health.  It 
describes  as  most  useful  the  population-based  data 
systems  that  integrate  health  and  disease  information 
with  environmental  data. 

Data  weaknesses  are  reviewed  in  four  major 
research  areas.  These  are:  how  better  to  identify  pop¬ 
ulation  groups  at  risk  of  hazardous  exposures;  how  to 
associate  precisely  health  effects  with  specific  ex¬ 
posures;  how  better  to  identify  and  how  to  measure 
more  accurately  exposures;  and  how  to  determine  en¬ 
vironmentally  related  disease  costs. 

The  current  lack  of  data  linking  human  exposures 
to  environmental  hazards  will  continue  to  be  a 
problem  in  the  future,  according  to  the  report, 
because  of  the  cost  and  difficulties  in  designing  data 
collection  systems.  Some  of  the  problems  include  the 
uncertainty  and  inaccuracy  of  measurement  tech¬ 
niques  for  estimating  individuals’  exposure  in  the 
work  place  and  community,  the  absence  of  baseline 
physiologic  data,  the  accessibility  of  data  already 
collected,  and  assessment  of  long-range  health  conse¬ 
quences  of  exposure  to  new  substances. 

Recommendations  offered  in  the  report  address  the 
need  for  setting  priorities  in  the  new  data  collection  ef¬ 
forts  and  in  interagency  coordination  in  data  collec¬ 
tion.  Integration  of  operational  data  systems, 
modifications  of  data  systems  to  include  more 
environmentally-related  information,  and  quality 
assurance  also  need  to  be  assigned  priorities.  The 
report  further  recommends  support  for  studies  using 
existing  data  bases,  evaluation  of  risk  assessment 
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methodology,  and  increased  training  of  environmental 
health  professionals. 

In  addition  to  the  data  collection  report.  Public 
Law  95-623  mandated  a  study  of  environmentally 
related  disease  costs,  which  currently  is  being  con¬ 
ducted  by  HHS  and  the  Institute  of  Medicine  of  the 
National  Academy  of  Sciences,  and  a  study  of  the 
issues  in  establishing  a  Federal  system  to  assist  in 
locating,  assessing,  and  treating  individuals  exposed 
to  hazardous  substances.  That  study  report  is  being 
prepared. 

Copies  of  the  report  are  available  on  request  to  the 
National  Center  for  Health  Statistics,  3700  East-West 
Highway,  Hyattsville,  Maryland  20782.  (LINDA 
W.VSHINCiTON.  NATIONAL  CENTER  FOR  HEALTH  STA¬ 
FFS  lICS,  DEPART.VIENTOF  HEALTH  AND  HUMAN  SERV- 
ICE.S,  telephone  (301)  436-8500) 

SOCIAL  SECURITY  PROGRAMS 
THROUGHOUT  THE  WORLD,  1979 

The  Social  Security  Administration  recently 
released  its  biennial  report  on  Social  Security  Programs 
Throughout  the  World,  1979  highlighting  the  principal 
features  of  social  security  systems  in  134  countries. 

The  data  reported  are  based  on  laws,  implementing 
decrees,  and  regulations  in  force  at  the  beginning  of 
1979.  Only  fully  independent  countries  are  covered;  a 
few  political  jurisdictions  have  been  excluded  because 
of  lack  of  data.  About  a  dozen  countries,  some  newly 
independent,  either  have  no  social  security  system  or 
have  issued  no  information  regarding  that  type  of 
social  legislation. 

The  general  social  security  system  of  each  country 
is  summarized  in  tabular  form.  The  charts  show  the 
major  features  of  each  system  and  are  arranged  to 
facilitate  intercountry  comparisons. 

Single  copies  of  Social  Security  Programs  Throughout  the 
World,  1979  (Research  Report  No.  54,  SSA  Publica¬ 
tion  No.  13-11805)  are  available  from  the  Publications 
Staff,  Office  of  Research  and  Statistics,  Social 
Security  .Administration,  Room  1120,  Universal 
North  Building,  1875  Connecticut  Avenue,  N.W., 
Washington,  D.C.  20009.  (ROBERT  E.  ROBINSON, 
SOCIAL  SECURm’  AD.\IINISTR.^TION,  DEPARTMENT 
OF  IIE.\L  i  H  AND  HU.MAN  .SERVICES,  telephone  (202) 
673-5576) 

REPORT  ON  STATE  SSI  PROGRAMS 

The  Social  Security  Administration’s  Office  of 
Research  and  Statistics  has  released  its  third  report 
on  The  Supplemental  Security  Income  Program  for  the  Aged, 
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Blind,  and  Disabled:  Selected  Characteristics  of  State  Sup¬ 
plementation  Programs,  as  of  October  1979. 

The  Federal  supplemental  security  income  (SSI) 
program  provides  basic  assistance  payments  to  needy 
aged,  blind,  and  disabled  persons.  The  program  is  ad¬ 
ministered  by  the  Social  Security  Administration. 
Legislation  also  provides  for  supplementation  of  the 
basic  Federal  payment  by  the  States.  These  State  pay¬ 
ments  are  required  by  law  to  maintain  the  income 
levels  of  former  assistance  recipients  now  in  the 
Federal  program  (“mandatory”  minimum  State  sup¬ 
plementation)  or  they  may  be  provided  by  State  op¬ 
tion  to  raise  the  payment  levels  of  former  recipients  or 
the  newly  eligible  (“optional”  State  supplementa¬ 
tion).  Additional  assistance  for  special  and  emergency 
needs  may  be  provided  at  State  option. 

This  is  the  third  report  on  State  supplementation 
program  characteristics  to  be  issued  since  the  SSI  pro¬ 
gram  was  initiated  in  January  1974.  The  report 
focuses  on  eligibility  provisions  and  basic  levels  of 
assistance  payments  for  persons  who  receive  sup¬ 
plementary  payments  as  of  October  1979. 

In  addition.  State  summary  tables  contain  informa¬ 
tion  on  the  governmental  unit  responsible  for  ad¬ 
ministering  mandatory  supplementary  payments; 
principal  reason  for  payment;  optional  State  sup¬ 
plementation  for  basic  needs  (recurring  monthly  ex¬ 
penses  for  food,  shelter,  clothing,  utilities,  and  daily 
living  necessities);  and  optional  State  supplementa¬ 
tion  for  special  needs  (emergency  or  special  conditions 
requiring  additional  assistance  not  provided  through 
monthly  SSI  or  optional  State  supplementary  pay¬ 
ments,  disaster  benefits,  burial  expenses,  additional 
subsidies  for  institutional  care,  and  moving  expenses). 

Single  copies  of  The  Supplemental  Security  Income 
Program  for  the  Aged,  Blind,  and  Disabled:  Selected  Charac¬ 
teristics  of  State  Supplementation  Programs  as  of  October  1979 
(SSA  Publication  No.  13-11975;  formerly  HEW 
Publication  No.  (SSA)  79-11975)  are  available  from 
the  Publications  Staff,  Office  of  Research  and  Statis¬ 
tics,  Social  Security  Administration,  Room  1120,  Uni¬ 
versal  Building,  1875  Connecticut  Avenue, 
N.W.,  Washington,  D.C.  20009.  (ROBERT  E.  ROB- 
iNso.N,  s(k;i,\l  security  administration,  depart - 

.\IENT'  OF  HEALTH  AND  HU.MAN  SERVICES,  telephone 
(202)  673-5576) 

SSI  STATE  AND  COUNTY  DATA 

The  Office  of  Research  and  Statistics  of  the  Social 
Security  Administration  has  released  Supplemental 
Security  Income  and  State  and  County  Data,  June  1979. 
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This  report  presents  data  on  State  and  county  dis¬ 
tribution  of  federally  administered  payments  to  per¬ 
sons  receiving  supplemental  security  income  in  June 
1979,  in  addition  to  State  data  on  the  combined 
amounts  of  Federal  supplemental  security  income 
payments  and  federally  administered  State  sup¬ 
plementary  payments. 

Also  reported  are  State  figures  reflecting  the  total 
number  of  persons  with  payments  during  the  month 
of  June  and  the  county  data  showing  the  number  of 
beneficiaries  receiving  payments  during  June  who 
were  also  eligible  for  supplemental  security  income 
payments  July  1,  1975. 

Single  copies  of  Supplemental  Security  Income  State  and 
County  Data,  June  1979  (SSA  Publication  No.  13- 
11976;  formerly  HEW  Publication  No.  (SSA)  11976) 
are  available  from  the  Publications  Staff,  Office  of 
Research  and  Statistics,  Social  Security  Administra¬ 
tion,  Room  1120,  Universal  North  Building,  1875 
Connecticut  Avenue,  N.W.,  Washington,  D.C.  20009. 
(Robert  E.  Robinson,  social  security  admin¬ 
istration,  DEPARTMENT  OF  HEALTH  AND  HUMAN 
SERVICES,  telephone  (202)  673-5576) 

SSA  CATALOG  OF  PUBLICATIONS 
AND  MICRODATA  FILES 

The  Research  Piblications  and  Microdata  Files  Spring 
7950  catalog  recently  released  by  Social  Security’s  Of¬ 
fice  of  Research  and  Statistics  provides  a  convenient 
source  of  ORS  publications  and  a  listing  of  its 
microdata  files. 

The  findings  of  studies  and  analyses  carried  out  or 
funded  by  SSA’s  Office  of  Research  and  Statistics  ap¬ 
pear  in  a  variety  of  technical  publications.  These  in¬ 
clude  the  monthly  Social  Security  Bulletin,  monographs 
issued  as  Research  Reports  or  Staff  Papers,  several 
note  series,  technical  papers,  and  a  number  of  annual 
statistical  releases.  The  catalog  contains  a  brief 
description  of  each  article  listed  by  title,  number,  and 
price  under  major  SSA  program  headings. 

In  order  to  support  policy  research  and  analysis 
carried  out  by  Social  Security  various  data  systems 
have  been  developed,  using  both  program  and  survey 
data.  ORS  has  made  microdata  files  from  several  of  its 
data  systems  available  to  outside  users.  This  catalog 
provides  a  listing  of  these  files  currently  available, 
describing  their  content  and  technical  features,  and 
telling  how  they  may  be  obtained. 

Copies  of  Research  Publication  and  Microdata  Files 
Spring  1980  (SSA  Publication  No.  13-11925)  are 
available  from  the  Publications  Staff,  Office  of 
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Research  and  Statistics,  Social  Security  Admin¬ 
istration,  Room  1120,  Universal  North  Building,  1875 
Connecticut  Avenue,  N.W.,  Washington,  D.C.  20009. 
(Robert  E.  Robinson,  social  security  admin¬ 
istration,  DEPARTMENT  OF  HEALTH  AND  HUMAN 
SERVICES,  telephone  (202)  673-5576) 

RECENT  NSF  REPORTS 

The  following  new  reports  have  recently  been 
issued  by  the  National  Science  Foundation; 

National  Patterns  of  Science  and  Technology  Resources, 
1980  (NSF  80-308)  is  the  first  volume  of  a  new  series. 
It  compiles  and  summarizes  information  on  R&D  ex¬ 
penditures  and  selected  employment  characteristics  of 
scientific  and  technical  personnel  engaged  in  research 
and  development  among  major  economic  sectors — 
government,  industry,  universities  and  colleges,  and 
independent  nonprofit  institutions.  The  report  first 
presents  an  integrated  summary  overview  of  U.S. 
science  and  technology  resources  based  on  the  most 
current  information  available  to  the  National  Science 
Foundation.  This  is  followed  by  a  more  detailed 
analysis  of  R&D  resources  as  viewed  from  a  national 
perspective,  including  estimates  for  1980.  An  appen¬ 
dix,  consisting  of  a  complete  set  of  time-series  tables, 
completes  the  report. 

Summarized  data  of  this  report  were  published  in 
Science  Resources  Studies  Highlights,  “National  R&D 
Spending  to  Exceed  $57  Billion  in  1980”  (NSF  79- 
309)  dated  May  8,  1979.  Copies  of  the  Highlights  are 
available  from  the  Division  of  Science  Resources 
Studies,  National  Science  Foundation,  Washington, 
D.C.  20550. 

Copies  of  the  report  (NSF  80-308)  are  available 
from  the  Superintendent  of  Documents,  U.S.  Govern¬ 
ment  Printing  Office,  Washington,  D.C.  20402  for 
$3.75  per  copy,  stock  number  038-000-00448-4. 

Academic  Science,  1972-77:  R&D  Funds,  Scientists  and 
Engineers,  and  Graduate  Enrollment  and  Support  (NSF  80- 
313)  is  the  first  in  a  series  of  consolidated  biennial 
analyses  of  academic  R&D  expenditures,  the  utiliza¬ 
tion  of  scientists  and  engineers,  and  the  characteristics 
of  the  graduate  science  student  population.  Data  from 
three  National  Science  Foundation  academic 
surveys — Survey  of  Scientific  and  Engineering  Expen¬ 
ditures  at  Universities  and  Colleges,  Survey  of  Scien¬ 
tific  and  Engineering  Personnel  Employed  at  Uni¬ 
versities  and  Colleges,  and  Survey  of  Graduate 
Science  Student  Support — provide  the  basis  for  most 
of  this  study.  In  prior  years,  information  from  each  of 


these  surveys  was  analyzed  and  published  separately. 
The  new  report  integrates  results  from  all  three  and 
analyzes  trends  in  more  detail. 

Copies  of  this  report  (NSF  80-313)  are  available 
from  the  Superintendent  of  Documents,  U.S.  Govern¬ 
ment  Printing  Office,  Washington,  D.C.  20402  for 
$4.25  per  copy.  Request  stock  number  038-000-00452- 
2. 

Also  released  was  Federal  Support  to  Universities, 
Colleges,  and  Selected  Non-profit  Institutions,  Fiscal  Year 
1978.  A  Report  to  the  President  and  Congress  (NSF  80-312). 
The  report  is  the  thirteenth  in  a  series  presenting  data 
on  Federal  support  to  academic  institutions.  It  pro¬ 
vides  a  comprehensive  picture  of  the  level  and  dis¬ 
tribution  of  all  Federal  funds  obligated  directly  to 
institutions  of  higher  education  and  of  obligations  for 
research,  development,  and  R&D  plant  to  selected 
nonprofit  institutions.  Data  are  provided  separately 
for  federally  funded  research  and  development  centers 
administered  by  institutions  of  higher  education  and 
by  nonprofit  institutions. 

Summarized  data  were  published  in  Science  Resources 
Studies  Highlights,  “Federal  Obligations  to  Uni¬ 
versities  and  Colleges  Continued  Real  Growth  in  FY 
1978”  (NSF  80-303)  dated  February  20,  1980.  Copies 
of  the  Highlights  are  available  from  the  Division  of 
Science  Resource  Studies,  National  Science  Founda¬ 
tion,  Washington,  D.C.  20402. 

Copies  of  the  report  (NSF  80-312)  are  available 
from  the  Superintendent  of  Documents,  U.S.  Govern¬ 
ment  Printing  Office,  Washington,  D.C.  20402  for 
$5.50  per  copy.  Request  stock  number  038-000-00451- 
4.  (Charles  E.  Falk,  division  of  science  re¬ 
sources  STUDIES,  NATIONAL  SCIENCE  FOUNDATION, 
telephone  (202)  634-4622) 

NEW  ASA  FELLOWS— 1980 

There  were  20  persons  named  as  “Fellows  of  the 
American  Statistical  Association”  in  a  ceremony  on 
August  12,  1980  at  the  Association’s  annual  meeting 
held  this  year  in  Houston,  Texas. 

The  only  Federal  Government  statistician  to 
achieve  this  honor  this  year  was  Roger  H.  Moore, 
Chief,  Statistical  Research  Division,  U.S.  Bureau  of 
the  Census.  He  was  cited  “for  sustained  efforts  in  the 
infusion  of  high-quality  statistical  theory  and  practice 
into  the  Nation’s  nuclear  energy  programs,  for  par¬ 
ticipation  and  promulgation  of  statistical  standards, 
and  for  outstanding  contributions  as  an  author  and 
editor  of  statistical  literature.” 
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PERSONNEL  NOTES 

DEPARTMENT  OF  COMMERCE 

Bureau  of  Ihe  Census:  Tbo  CLemence  has  been  designated  Senior 
Advisor  to  the  Deputy  Director  and  will  devote  substantial  time  to 
research  and  preparation  of  materials  on  program  and  policy  mat¬ 
ters.  Sherry  CbUTRiANO  will  assume  the  position  of  Chief,  OfTice 
of  Program  and  Policy  Development. 

Mich.\el  G.  Farrell  is  designated  Chief,  Economic  Surveys 
Division.  Farrell  was  formerly  with  Business  Division  for  18  years. 

Ar.noli)  L.  Bollenbacher  is  designated  Chief,  Agriculture 
Division. 

F.aran  E.  Stoetzel  was  reassigned  to  the  position  of  Chief, 
Current  Retail  Inventory  and  Sales  Branch,  Business  Division.  Mr. 
Stoetzel  was  formerly  Chief  of  the  Wholesale  Census  Branch. 

David  L.  Rdndelier  is  designated  Chief,  Building  Permits 
Branch,  Construction  Statistics  Division. 

Harold  Blyweiss  is  designated  Chief,  Trade  Practices  and 
Regulations  Branch  and  Paul  E.  DeQccio  as  Chief,  Chemicals, 
Machinery,  and  General  Manufactures  Branch,  Foreign  Trade 
Division. 

David  P.  Warner  is  designated  Staff  Assistant,  Office  of  the 
Associate  Director  for  Administration,  Bureau  of  the  Census. 

RtXiER  H.  Bugenhagen  is  designated  Chief,  Industry  Division. 

Carl  A.  Konschnik  has  been  designated  as  Chief,  Statistical 
Methods  Branch,  Dorothy  Reynolds  is  designated  Assistant 
Chief  for  Current  Programs,  and  Bobby  Russell  is  designated 
Assistant  Chief  for  Census  Programs,  Business  Division. 

RtXiER  H.  Moore  was  designated  Chief,  Statistical  Research 
Division.  Moore  was  with  the  Nuclear  Regulatory  Commission  as 
Chief  of  the  Applied  Statistics  Branch. 

DEPARTMENT  OF  EDUCATION 

National  Center  for  Education  Statistics:  DwiGHT  OlUM  is  the  new 
Director,  Office  of  Program  and  Budget  Planning  and  Evaluation. 

Mr.  Crum  formerly  served  as  Director,  Office  of  Private  School 
Liaison,  and  Deputy  Director  of  the  Divisions  of  Manpower  Train¬ 
ing  and  Vocational  Education  in  OE.  David  Sweet,  formerly  an 

IPA  with  the  Assistant  Secretary  for  Planning  and  Evaluation  from 
the  California  State  Department  of  Education,  has  been  appointed 
Assistant  Administrator,  Division  of  Multilevel  Education  Statis¬ 
tics. 

Paul  Bie.vier  was  designated  Chief,  Response  Variance  Studies 
Branch,  Statistical  Methods  Division  and  James  L.  Dnwiddie  as 
Chief,  Census  Surveys  Branch,  Straistical  Methods  Division. 

John  C.  Womack  has  been  appointed  Chief,  Outlying  Areas 
Statistics  Branch,  Agriculture  Division. 

FEDERAL  RESERVE  BOARD  | 

Division  of  Research  and  Statistics:  ARNOLD  Kling.  who  recently 
received  his  Ph.D.  from  MIT,  has  joined  the  Board’s  staff  as  an 
economist  in  the  Financial  Studies  Section. 

1 

Death 

Robert  L.  Stein,  an  assistant  commissioner  at  the  Bureau  of 
Labor  Statistics,  died  July  26, 1980.  Recognized  as  an  expert  on  the 
Current  Population  Survey,  Stein  began  his  government  career  in 

BLS,  served  for  many  years  in  the  Census  Bureau,  then  returned  to 
the  BLS  and  became  Assistant  Commissioner  for  Current  Employ¬ 
ment  Analysis,  a  position  he  held  at  the  time  of  his  death. 
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SCHEDULE  OF  RELEASE  DATES  FOR 
PRINCIPAL  FEDERAL  ECONOMIC  INDICATORS 


October  1980 


Release  dates  scheduled  by  agencies  responsible  for 
the  principal  economic  indicators  of  the  Federal 
Government  are  given  below.  These  are  target  dates  that 
will  be  met  in  the  majority  of  cases.  Occasionally  agencies 
may  be  able  to  release  dates  a  day  or  so  earlier  or  may  be  forced 
by  unavoidable  compilation  problems  to  release  a  report  one  or 
more  days  later.  In  certain  cases,*  timing  variability  in 
the  receipt  of  raw  data  requires  a  range  of  dates  rather 
than  a  specific  release  date. 


A  similar  schedule  will  be  shown  here  each  month 
covering  release  dates  for  the  following  month.  The  in¬ 
dicators  are  identified  by  the  title  of  the  releases  in 
which  they  are  included;  the  source  agency;  and  the 
release  identification  number  where  applicable. 
Release  date  information  for  additional  series  can  be 
found  in  publications  of  the  sponsoring  agencies. 


(Any  inquiries  about  these  series  should  be  directed  to  the  issuing  agency). 


Date  Subject  Data  For 

October  1  Construction  Expenditures  (Press  release), 

Census,  C-30 . August 

1  Manufacturers’  Shipments,  Inventories, 

and  Orders,  Census,  M3-1  . August 

2  Selected  Interest  Rates,  FRB,  G.13 . September 

3  The  Employment  Situation  (Press  release). 

Bureau  of  Labor  Statistics  (BLS) . September 

3  Factors  Affecting  Bank  Reserves  and  Condition 
Statement  of  Federal  Reserve  Banks,  Federal 

Reserve  Board  (FRB),  H.4.1 . Week  Ending  October  1 

3  Weekly  Consolidated  Condition  Report  of  Large 
Commercial  Banks  and  Domestic  Subsidiaries, 

FRB,  H.4.2  . Week  Ending  September  24 

3  Money  Stock  Measures, 

FRB,  H.6 . Week  Ending  September  24 

3  Producer  Price  Indexes  (Press  release),  BLS . September 

*6-7  Consumer  Installment  Credit,  FRB,  G.  19  . August 

7  Monthly  Wholesale  Trade  (Press  release), 

Census,  BW . August 

7  Manufacturers’  Export  Sales  and  Orders, 

Census,  M4-A  . August 

8  Sales,  Inventories  of  Single-Family  Homes, 

Census,  C-2  5  . August 

8  Monthly  Selected  Services  Receipts 

(Press  release).  Census . August 


September  1980 


439 


Subject 


Data  for 


Date 

October  10  Factors  Affecting  Bank  Reserves  and  Condition 
Statement  of  Federal  Reserve  Banks 

FRB,  H.4. 1  . Week  Ending  October  8 

10  Weekly  Consolidated  Condition  Report  on  Large 
Commercial  Banks  and  Domestic  Subsidiaries, 

FRB,  H.4.2  . Week  Ending  October  1 

10  Money  Stock  Measures. 

FRB,  H.6 . Week  Ending  October  1 

10  .Advance  Monthly  Retail  Sales  (Press  release). 

Census  (54)  . September 

10  Crop  Production,  Agriculture . October  1 

14  Manufacturing  and  Trade;  Inventories  and  Sales, 

Census . August 

14  Supply/Demand  Estimates, 

Agriculture . Current  Marketing  Season 

16  Personal  Income  and  Outlays,  Bureau  of  Economic  .Analysis 

(BE.A)  . September 

16  Yields  on  FHA  Insured  New  Home  .50-year 

.Mortgages,  HUD . October  1 

17  Factors  .Affecting  Bank  Reserves  and  Condition 

Statement  of  Federal  Reserve  Banks, 

FRB,  H.4.1  . Week  Ending  October  15 

17  Weekly  Consolidated  Condition  Report  on  Large 
Commerical  Banks  and  Domestic  Subsidiaries, 

FRB,  H.4.2  . Week  Ending  October  8 

17  .Money  .Stock  Measures, 

FRB,  H.6 . Week  Ending  October  8 


17  Gross  National  Products  (Preliminary),  BE.A . .5Q'80 

17  Housing  Starts  (Press  release),  C.ensus,  C;-20  . .September 

*15-17  Industrial  Production,  FRB,  G.  12. .5 . .September 

20  Cattle  on  Feed,  .Agriculture  . October  1 

*16-20  Capacity  Utilization:  .Manufacturing  and 

.Materials.  FRB,  G..5 . September 

22  .Advance  Report  on  Durable  Goods,  .Manufacturers’ 

■Shipments  and  Orders  (Press  release). 

Census,  .M.5-1 . .September 

2.5  Grain  .Stocks  Report, 

.Agriculture . October  1 

24  Consumer  Price  Index  (Press  release),  BLS  . September 

24  Real  Earnings,  (Press  release),  BL.S . September 

24  Factors  .Affecting  Bank  Reserves  and  Condition 
.Statement  of  Federal  Reserve  Banks, 


FRB,  H.4.1  . Week  Ending  October  22 

24  Weekly  Consolidated  Condition  Report  of  Large 
Commercial  Banks  and  Domestic  .Subsidiaries, 

FRB,  H.4.2  . Week  Ending  October  15 

24  .Money  .Stock  .Measures,  FRB,  H.6  ....  Week  Ending  October  15 
24  Treasury  .Statement  (the  monthly  “budget”). 

Treasury  . .September 

24  Supply/ Demand  Estimates, 

.Agriculture . Current  .Marketing  Season 
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Date 


Siihjftl 


Data  for 


October  27  Housing  Vacancies  (Press  release). 

Census,  H-1 11  . 3Q'8() 

27  Productivity  and  Costs  in  Private 
Business,  Nonfarm  Business,  and 
Manufacturing  Sectors  (Press  release), 

BLS . 3Q'8() 

27  Major  Collective  Bargaining  .Settlements 

(Press  release),  BLS . 3Q'80 

28  Export  and  Import  Merchandise  Trade, 

Census,  FT-90()  . Sejitember 

28  Work  Stoppages  (Press  release),  BL.S . September 

*27-29  Savings  and  Loan  Association  Activity 
(Press  release).  Federal  Home  Loan 

Bank  Board  . .September 

30  Composite  Indexes  of  Leading.  Coincident,  and 

Lagging  Indicators  (Press  release),  BEA . .Se|)tembcr 

30  Labor  Turnover  in  Manufacturing 

(Press  release),  BL.S . .Sc|)tember 

31  Factors  Affecting  Bank  Reserves  and  Condition 

Statement  of  Federal  Reserve  Banks. 

FRB,  H.4.1  . Week  Ending  October  29 

31  Weekly  Consolidated  Condition  Report  of  Large 
Commercial  Banks  and  Domestic  Subsidiaries, 

FRB,  H. 4. 2  . Week  Ending  October  22 

31  Money  Stock  Measures, 

FRB,  H.6 . Week  Ending  Oc  tober  22 

31  .Agricultural  Prices,  .Agriculture . Mid-October 

31  -Manufacturers’  .Shipments,  Inventories,  and 

Orders,  Census,  M3- 1  .Se|)tember 


For  sale  by  the  .Superintendent  of  Documents,  U.S.  Government  Printing  Office,  Washington,  D.C.  20402. 
Subscription  Price:  JI3.00  domestic  postpaid;  S3. 25  additional  foreign  mailing. 
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INDISPENSABLE 

for  those  who  make  their  living  numbers- 

Basic  economic  data 
from  the  Bureau  of  Economic  Analysis 


A  must  for  GNP  data  uaara. 


A  muat  for  butinasa  cycla  analyata. 


SURVEY  WEEKLY  BUSINESS 

CURRENT  BUSINESS.  BUSINESS  STATISTICS.  CONDITIO] 

The  journal  of  record  and  A  weekly  updating  service  for  The  Wall  St 

research  of  the  Bureau  of  data  that  appear  in  the  it  was  “the  sii 

Economic  Analysis.  statistical  (blue)  pages  of  the  government  p 

r.  LI-  L  j  .ui  Survey  of  Current  Business.  the  opinion  o 

Pubiished  monthly. 

U.S.  Department  of  Commerce,  Bureau  of  Economic  Analysis  Published  mo 


ENTER  MY  SUBSCRIPTION  TO 
Survey  of  Current  Business. 

Annual  subscription:  Domestic;  $22.00  second  class;  $35.00  first  class;  Foreign:  $27.50. 

Weekly  Business  Statistics. 

Annual  subscription:  Domestic;  $22.00  first  class;  Foreign;  $27.50 . 

Business  Conditions  Digest. 

Annual  subscription:  Domestic;  $40.00  first  class;  Foreign:  $50.00 . 


BUSINESS 
CONDITIONS  DIGEST. 

The  Wall  Street  Journal  said 
it  was  “the  single  most  useful 
government  publication,  in 
the  opinion  of  many 
analysts.”  (March  21,  1977) 

Published  monthly. 


Order  from  the  Superintendent  of  Documents,  Telephone  order  desk:  (202)  783-3238 
Governement  Printing  Office,  Washington,  D.C.  20402. 

Charge  to  DEPOSIT  ACCOUNT,  MASTER  CHARGE,  VISA 

I  NAME  -FIRST,  LAST  I 


COMPANY  NAME  OR  AOOITIONAL  ADORESS  LINE 


□  Remittance  Enclosed 

(Make  checks  payable 
to  Superintendent  of 
Documents) 

□  Charge  to  my  Deposit 
Account  No. 


MAIL  ORDER  FORM  TOi 

Superintendent  of  Documents 
Government  Printing  Office 
Washington.  D  C.  20402 


24  Hour  CPI  Mailgram  Service 


Consumer  Price  Index  data  now  are  available  by  mail- 
gram  within  24  hours  of  the  CPI  release.  The  new  service 
is  being  offered  by  the  Bureau  of  Labor  Statistics  through 
the  National  Technical  Information  Service  of  the  U.S. 
Department  of  Commerce. 

The  CPI  MAILGRAM  service  provides  unadjusted  and 
seasonally  adjusted  data  both  for  the  All  Urban  Consumers 


(CPI-U)  and  for  the  Urban  Wage  Earners  and  Clerical 
Workers  (CPI-W)  Indexes  as  shown  on  the  CPI-U  sample 
page  below.  The  unadjusted  data  include  the  current 
month’s  index  and  the  percent  changes  from  12  months 
ago  and  one  month  ago.  The  seasonally  adjusted  data  are 
the  percent  changes  from  one  month  ago. 


CONSUMER  PRICE  INDEX  FOR  ALL  URBAN  CONSUMERS  (CPI-U):  u.S.  CITY 
AVERAGE  (  1967:  IOC) 

UNADJ  UNADJUSTED  S  > 


GROUP 

INDEX 

PER  CHG  FER 

CHG  PER 

CHG 

MAY 

FROM  12  FROM  1  FROM  1 

1979 

MO  AGO  MO 

AGO  MO 

AGO 

ALL  ITEMS 

214.  1 

10.8 

1.2 

1 .  1 

ALL  ITEMS( 1957-59=100) 

249.0 

- 

- 

- 

FOOD  AND  BEVERAGES 

228.2 

11.2 

.8 

.  y 

FOOD 

234. S 

11.4 

.  9 

.7 

FOOD  AT  HOME 

233.4 

11.3 

.7 

.5 

CEREALS  AND  BAKERY  PRODUCTS 

216.2 

9.5 

.8 

1.0 

MEATS.  POULTRY.  FISH.  AND 

EGGS 

242.2 

19.4 

.9 

.  1 

DAIRY  PRODUCTS 

293.8 

11.1 

.  7 

.8 

FRUITS  AND  VEGETABLES 

226.8 

3.4 

.  1 

-.2 

FOOD  AUAY  FRO.M  HOME 

241.1 

11.7 

1 .  1 

1 .  1 

HOUSING 

222.4 
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